Jul 07 11:38:08.691823 ip-10-0-138-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 11:38:08.691835 ip-10-0-138-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 11:38:08.691842 ip-10-0-138-101 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 11:38:08.692094 ip-10-0-138-101 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 11:38:18.804432 ip-10-0-138-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 11:38:18.804452 ip-10-0-138-101 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 460238d135794cf792d5b46398b573c3 --
Jul 07 11:40:11.552770 ip-10-0-138-101 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 11:40:11.950607 ip-10-0-138-101 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:40:11.950607 ip-10-0-138-101 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 11:40:11.950607 ip-10-0-138-101 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:40:11.950607 ip-10-0-138-101 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 11:40:11.950607 ip-10-0-138-101 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 11:40:11.952358 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.952275    2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 11:40:11.956635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956621    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.956635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956635    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956639    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956642    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956645    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956648    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956651    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956654    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956656    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956660    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956662    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956666    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956669    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956678    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956681    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956683    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956686    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956688    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956691    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956693    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956696    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956699    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.956696 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956701    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956704    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956707    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956710    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956712    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956715    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956719    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956723    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956726    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956731    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956733    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956736    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956739    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956741    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956744    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956746    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956749    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956751    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956753    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.957205 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956756    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956758    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956761    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956763    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956766    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956768    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956771    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956773    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956775    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956778    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956780    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956783    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956785    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956788    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956790    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956793    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956796    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956799    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956801    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956805    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.957695 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956807    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956810    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956812    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956815    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956817    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956820    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956822    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956825    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956827    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956829    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956832    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956834    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956837    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956839    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956842    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956845    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956847    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956849    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956852    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.958175 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956855    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956857    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956861    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956864    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956866    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956869    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956871    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956874    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956877    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956880    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956882    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956885    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956887    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956890    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956892    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956894    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956897    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956899    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.958635 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.956902    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957581    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957589    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957592    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957595    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957598    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957600    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957603    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957605    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957608    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957611    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957615    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957618    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957620    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957623    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957626    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957628    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957631    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957633    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.959092 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957636    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957639    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957641    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957645    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957648    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957651    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957653    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957656    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957659    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957661    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957664    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957667    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957669    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957672    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957674    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957676    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957679    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957682    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957685    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957687    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.959587 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957690    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957692    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957695    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957697    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957700    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957713    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957716    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957719    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957723    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957725    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957728    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957730    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957733    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957735    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957738    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957741    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957744    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957748    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957752    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957754    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.960067 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957757    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957760    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957763    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957765    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957768    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957771    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957773    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957776    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957778    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957780    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957783    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957785    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957789    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957791    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957794    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957796    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957798    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957801    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957803    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957806    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.960581 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957808    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957811    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957814    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957816    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957819    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957821    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957824    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957827    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957829    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957832    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957834    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957837    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957839    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957842    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957844    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957846    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957849    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957851    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957854    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957856    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.961054 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.957859    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958194    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958199    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958202    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958204    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958207    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958209    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958212    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958215    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958217    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958220    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958222    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958225    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958228    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958230    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958233    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958235    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958238    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958241    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958244    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.961544 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958247    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958250    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958252    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958255    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958257    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958260    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958262    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958265    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958267    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958270    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958273    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958275    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958277    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958280    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958282    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958285    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958288    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958291    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958293    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958296    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.962027 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958298    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958301    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958304    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958306    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958309    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958312    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958315    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958317    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958319    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958322    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958324    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958331    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958333    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958336    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958338    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958342    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958346    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958348    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958351    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958353    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.962500 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958355    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958358    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958360    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958363    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958365    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958368    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958370    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958373    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958377    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958380    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958383    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958386    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958388    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958391    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958394    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958396    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958400    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958403    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958406    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.962972 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958409    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958412    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958415    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958417    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958421    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958423    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958426    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958428    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958430    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958433    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958435    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958438    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958440    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958443    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958445    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958448    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958450    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958452    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958455    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.963418 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958457    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.958460    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958555    2573 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958577    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958584    2573 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958589    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958593    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958596    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958600    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958604    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958607    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958610    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958613    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958617    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958620    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958623    2573 flags.go:64] FLAG: --cgroup-root=""
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958626    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958630    2573 flags.go:64] FLAG: --client-ca-file=""
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958633    2573 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958636    2573 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958640    2573 flags.go:64] FLAG: --cluster-domain=""
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958643    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958646    2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958649    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 11:40:11.963900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958652    2573 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958656    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958659    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958662    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958666    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958668    2573 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958671    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958675    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958679    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958682    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958686    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958689    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958692    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958695    2573 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958698    2573 flags.go:64] FLAG: --enable-server="true"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958701    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958708    2573 flags.go:64] FLAG: --event-burst="100"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958711    2573 flags.go:64] FLAG: --event-qps="50"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958714    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958717    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958719    2573 flags.go:64] FLAG: --eviction-hard=""
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958723    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958726    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958729    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958732    2573 flags.go:64] FLAG: --eviction-soft=""
Jul 07 11:40:11.964472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958736    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958739    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958742    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958745    2573 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958748    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958750    2573 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958753    2573 flags.go:64] FLAG: --feature-gates=""
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958756    2573 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958760    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958763    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958765    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958768    2573 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958771    2573 flags.go:64] FLAG: --help="false"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958774    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-101.ec2.internal"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958777    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958781    2573 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958784    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958787    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958791    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958794    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958796    2573 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958799    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958802    2573 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 11:40:11.965157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958804    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958808    2573 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958810    2573 flags.go:64] FLAG: --kube-reserved=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958813    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958816    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958819    2573 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958822    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958824    2573 flags.go:64] FLAG: --lock-file=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958827    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958832    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958835    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958840    2573 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958842    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958845    2573 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958848    2573 flags.go:64] FLAG: --logging-format="text"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958851    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958854    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958857    2573 flags.go:64] FLAG: --manifest-url=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958859    2573 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958863    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958866    2573 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958870    2573 flags.go:64] FLAG: --max-pods="110"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958873    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958876    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958880    2573 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 11:40:11.965810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958883    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958886    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958888    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958891    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958898    2573 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958901    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958904    2573 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958907    2573 flags.go:64] FLAG: --pod-cidr=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958910    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958915    2573 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958917    2573 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958921    2573 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958923    2573 flags.go:64] FLAG: --port="10250"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958926    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958929    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05a36cbef6dc68a23"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958932    2573 flags.go:64] FLAG: --qos-reserved=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958935    2573 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958940    2573 flags.go:64] FLAG: --register-node="true"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958943    2573 flags.go:64] FLAG: --register-with-taints=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958946    2573 flags.go:64] FLAG: --registry-burst="10"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958949    2573 flags.go:64] FLAG: --registry-qps="5"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958952    2573 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958955    2573 flags.go:64] FLAG: --reserved-memory=""
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958958    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958961    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 11:40:11.966774 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958964    2573 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958966    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958969    2573 flags.go:64] FLAG: --runonce="false"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958972    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958974    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958977    2573 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958981    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958984    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958987    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958990    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958992    2573 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958995    2573 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.958998    2573 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959001    2573 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959003    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959006    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959009    2573 flags.go:64] FLAG: --system-cgroups=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959012    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959017    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959020    2573 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959022    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959026    2573 flags.go:64] FLAG: --tls-min-version=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959029    2573 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959031    2573 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959036    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 11:40:11.967395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959039    2573 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959041    2573 flags.go:64] FLAG: --v="2"
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959045    2573 flags.go:64] FLAG: --version="false"
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959049    2573 flags.go:64] FLAG: --vmodule=""
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959053    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.959056    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959162    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959166    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959169    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959172    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959175    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959178    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959181    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959185    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959188    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959191    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959194    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959196    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959199    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959202    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959206    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.968002 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959209    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959213    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959216    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959220    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959223    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959226    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959228    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959231    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959233    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959236    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959240    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959243    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959246    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959248    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959251    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959254    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959256    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959259    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959262    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.968527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959266    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959269    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959272    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959275    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959278    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959281    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959284    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959287    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959289    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959292    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959294    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959297    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959299    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959302    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959304    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959307    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959309    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959312    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959314    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959317    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.969140 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959319    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959322    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959324    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959328    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959330    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959333    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959336    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959338    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959341    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959343    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959346    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959348    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959351    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959353    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959356    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959358    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959360    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959364    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959367    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959369    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.969637 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959372    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959374    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959377    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959379    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959382    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959385    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959387    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959390    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959392    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959394    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959397    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959399    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959402    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959404    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959407    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959410    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959412    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959415    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959418    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.970146 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959420    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959423    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959425    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959428    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959430    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.959433    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.960011    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.967747    2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.967761    2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.968403    2573 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.968411    2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968466    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968471    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968474    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968478    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.970616 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968480    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968483    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968486    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968489    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968506    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968510    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968513    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968516    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968519    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968522    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968525    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968528    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968531    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968534    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968537    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968540    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968543    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968545    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968548    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968550    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.970996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968553    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968555    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968558    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968561    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968563    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968566    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968568    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968572    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968574    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968577    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968579    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968583    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968587    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968590    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968593    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968595    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968598    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968600    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968603    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968605    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.971482 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968608    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968610    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968613    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968615    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968619    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968622    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968625    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968628    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968631    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968634    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968638    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968642    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968645    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968648    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968651    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968654    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968657    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968659    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968662    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.972004 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968665    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968667    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968670    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968672    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968675    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968677    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968680    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968682    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968684    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968687    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968689    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968692    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968695    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968697    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968700    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968702    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968706    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968708    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968710    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.972458 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968713    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968715    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968718    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968720    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968723    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968725    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968728    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968730    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968732    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968735    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968737    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968740    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968742    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968745    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968748    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968750    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.972937 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968752    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.968758    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968863    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968869    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968872    2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968875    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968878    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968880    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968883    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968886    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968888    2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968891    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968893    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968896    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968899    2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 11:40:11.973328 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968901    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968904    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968906    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968909    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968911    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968914    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968916    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968918    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968921    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968923    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968926    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968928    2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968931    2573 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968934    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968937    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968940    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968942    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968945    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968947    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 11:40:11.973700 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968950    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968954    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968957    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968960    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968962    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968965    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968967    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968970    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968973    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968975    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968979    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968982    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968984    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968987    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968990    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968992    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968995    2573 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.968997    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969000    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 11:40:11.974176 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969002    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969005    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969007    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969010    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969012    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969015    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969017    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969020    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969022    2573 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969024    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969027    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969030    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969032    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969037    2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969039    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969042    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969045    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969047    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969050    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969052    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 11:40:11.974645 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969055    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969057    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969060    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969062    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969065    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969068    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969070    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969073    2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969075    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969078    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969081    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969083    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969086    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969088    2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969091    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969093    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969096    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969100    2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969103    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 11:40:11.975109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969106    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969109    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969112    2573 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969114    2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969117    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969120    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969124    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969127    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:11.969130    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.969134    2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.969227    2573 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.972665    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.973904    2573 server.go:1019] "Starting client certificate rotation"
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.974001    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 11:40:11.975691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.974030    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 11:40:11.977099 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.977085    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 11:40:11.978425 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.978410    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 11:40:11.988446 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.988426    2573 log.go:25] "Validated CRI v1 runtime API"
Jul 07 11:40:11.992889 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.992874    2573 log.go:25] "Validated CRI v1 image API"
Jul 07 11:40:11.993815 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.993800    2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 11:40:11.998210 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.998194    2573 fs.go:135] Filesystem UUIDs: map[025c16b9-d52d-4779-921c-6e61c1491782:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b313f9d9-fdd6-4a39-a759-00c428c5aa4f:/dev/nvme0n1p4]
Jul 07 11:40:11.998286 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:11.998211    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 11:40:12.003383 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.003277    2573 manager.go:216] Machine: {Timestamp:2026-07-07 11:40:12.002034906 +0000 UTC m=+0.331985450 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099211 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212448d0d20c93f77aab0e01ffd596 SystemUUID:ec212448-d0d2-0c93-f77a-ab0e01ffd596 BootID:460238d1-3579-4cf7-92d5-b46398b573c3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:1a:b9:2a:b9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:1a:b9:2a:b9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:84:ec:03:bd:5c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 11:40:12.003383 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.003372    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 11:40:12.003516 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.003448    2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 11:40:12.006414 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.006395    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 11:40:12.007366 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.007336    2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 11:40:12.007570 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.007376    2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 11:40:12.008511 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.008488    2573 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 11:40:12.008543 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.008515    2573 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 11:40:12.008543 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.008523    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 11:40:12.009129 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.009119    2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 11:40:12.010609 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.010600    2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 11:40:12.013717 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013698    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 11:40:12.013828 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013819    2573 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 11:40:12.013857 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013848    2573 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 11:40:12.013887 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013859    2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 11:40:12.013887 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013873    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 11:40:12.013887 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013881    2573 kubelet.go:398] "Adding apiserver pod source"
Jul 07 11:40:12.013985 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.013890    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 11:40:12.014287 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.014276    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 11:40:12.014330 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.014295    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 11:40:12.016944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.016928    2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 11:40:12.018755 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.018738    2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 11:40:12.018841 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.018777    2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 11:40:12.019697 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019684    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019707    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019716    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019722    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019731    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019736    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019744    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 11:40:12.019749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019750    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 11:40:12.019922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019757    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 11:40:12.019922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019763    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 11:40:12.019922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019772    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 11:40:12.019922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.019777    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 11:40:12.020544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.020533    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 11:40:12.020581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.020545    2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 11:40:12.023854 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.023840    2573 server.go:1268] "Started kubelet"
Jul 07 11:40:12.024037 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.023983    2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 11:40:12.024114 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.024053    2573 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 11:40:12.024333 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.024288    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 11:40:12.024751 ip-10-0-138-101 systemd[1]: Started Kubernetes Kubelet.
Jul 07 11:40:12.025114 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.025089    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 11:40:12.025201 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.025138    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 11:40:12.025201 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.025164    2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 11:40:12.025673 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.025647    2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 11:40:12.026197 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.026186    2573 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 11:40:12.028340 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.028321    2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 11:40:12.031952 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.031934    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 11:40:12.031952 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.031943    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 11:40:12.032138 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.032117    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.032395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032377    2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 11:40:12.032395 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032380    2573 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 11:40:12.032581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032404    2573 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 11:40:12.032581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032572    2573 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 11:40:12.032677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032583    2573 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 11:40:12.032926 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032911    2573 factory.go:153] Registering CRI-O factory
Jul 07 11:40:12.032998 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032931    2573 factory.go:223] Registration of the crio container factory successfully
Jul 07 11:40:12.032998 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032981    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 11:40:12.032998 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032989    2573 factory.go:55] Registering systemd factory
Jul 07 11:40:12.032998 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.032996    2573 factory.go:223] Registration of the systemd container factory successfully
Jul 07 11:40:12.033146 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.033017    2573 factory.go:103] Registering Raw factory
Jul 07 11:40:12.033146 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.033029    2573 manager.go:1196] Started watching for new ooms in manager
Jul 07 11:40:12.033434 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.033422    2573 manager.go:349] Starting recovery of all containers
Jul 07 11:40:12.034629 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.033594    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc27072ad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.023812781 +0000 UTC m=+0.353763328,LastTimestamp:2026-07-07 11:40:12.023812781 +0000 UTC m=+0.353763328,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.038023 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.037989    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 11:40:12.038158 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.038131    2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 11:40:12.044449 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.044431    2573 manager.go:354] Recovery completed
Jul 07 11:40:12.048818 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.048806    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.050470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.050446    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.050558 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.050482    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.050558 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.050507    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.051057 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051045    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 11:40:12.051057 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051051    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.051177 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051055    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 11:40:12.051177 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051077    2573 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 11:40:12.051716 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051701    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.051785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051727    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.051785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.051741    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.052428 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.052416    2573 policy_none.go:49] "None policy: Start"
Jul 07 11:40:12.052486 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.052433    2573 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 11:40:12.052486 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.052452    2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 11:40:12.052553 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.052454    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc4072fa5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050468773 +0000 UTC m=+0.380419317,LastTimestamp:2026-07-07 11:40:12.050468773 +0000 UTC m=+0.380419317,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.053615 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.053602    2573 policy_none.go:47] "Start"
Jul 07 11:40:12.063768 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.062841    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc40774d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050486483 +0000 UTC m=+0.380437027,LastTimestamp:2026-07-07 11:40:12.050486483 +0000 UTC m=+0.380437027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.073956 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.073819    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc407da43  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050512451 +0000 UTC m=+0.380462996,LastTimestamp:2026-07-07 11:40:12.050512451 +0000 UTC m=+0.380462996,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.086565 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.086473    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-101.ec2.internal.18bfff0dc4072fa5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc4072fa5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050468773 +0000 UTC m=+0.380419317,LastTimestamp:2026-07-07 11:40:12.051714254 +0000 UTC m=+0.381664798,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.090066 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090053    2573 manager.go:337] "Starting Device Plugin manager"
Jul 07 11:40:12.090108 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.090083    2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 11:40:12.090108 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090093    2573 server.go:87] "Starting device plugin registration server"
Jul 07 11:40:12.090329 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090317    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 11:40:12.090369 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090331    2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 11:40:12.090451 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090435    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 11:40:12.090565 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090532    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 11:40:12.090565 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.090541    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 11:40:12.091036 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.091014    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 11:40:12.091132 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.091061    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.096747 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.096692    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-101.ec2.internal.18bfff0dc40774d3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc40774d3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050486483 +0000 UTC m=+0.380437027,LastTimestamp:2026-07-07 11:40:12.051734046 +0000 UTC m=+0.381684592,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.106549 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.106470    2573 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-101.ec2.internal.18bfff0dc407da43\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc407da43  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.050512451 +0000 UTC m=+0.380462996,LastTimestamp:2026-07-07 11:40:12.051744757 +0000 UTC m=+0.381695301,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.116664 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.116592    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-101.ec2.internal.18bfff0dc6839c8d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-101.ec2.internal,UID:ip-10-0-138-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-138-101.ec2.internal,},FirstTimestamp:2026-07-07 11:40:12.092177549 +0000 UTC m=+0.422128080,LastTimestamp:2026-07-07 11:40:12.092177549 +0000 UTC m=+0.422128080,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-101.ec2.internal,}"
Jul 07 11:40:12.131696 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.131679    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rf6xp"
Jul 07 11:40:12.137761 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.137746    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-rf6xp"
Jul 07 11:40:12.166194 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.166165    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 11:40:12.167381 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.167364    2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 11:40:12.167470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.167400    2573 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 11:40:12.167470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.167421    2573 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 11:40:12.167470 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.167452    2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 11:40:12.176876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.176859    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:40:12.190732 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.190711    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.191481 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.191466    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.191571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.191507    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.191571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.191521    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.191571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.191542    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.201243 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.201202    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.201243 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.201223    2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-101.ec2.internal\": node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.214714 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.214697    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.268038 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.268019    2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"]
Jul 07 11:40:12.268091 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.268073    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.269445 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.269431    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.269521 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.269458    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.269521 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.269471    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.270572 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.270560    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.270675 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.270663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.270718 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.270689    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.271194 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271182    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.271260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271205    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.271260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271219    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.271573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271559    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.271633 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271584    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.271633 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.271595    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.273116 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.273102    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.273187 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.273124    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:12.273797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.273781    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:12.273797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.273805    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:12.273941 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.273814    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:12.296149 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.296127    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-101.ec2.internal\" not found" node="ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.300356 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.300340    2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-101.ec2.internal\" not found" node="ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.315799 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.315780    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.416410 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.416389    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.433882 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.433864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.433991 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.433891    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.433991 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.433911    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b6c8b6d42e5b52ab4cf9f706a9be0f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"9b6c8b6d42e5b52ab4cf9f706a9be0f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.516814 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.516751    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.534338 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534312    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.534420 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.534420 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534412    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.534536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b6c8b6d42e5b52ab4cf9f706a9be0f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"9b6c8b6d42e5b52ab4cf9f706a9be0f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.534536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534414    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9ccd326e5056db2ec15b8f22d5755cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"a9ccd326e5056db2ec15b8f22d5755cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.534536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.534481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9b6c8b6d42e5b52ab4cf9f706a9be0f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"9b6c8b6d42e5b52ab4cf9f706a9be0f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.602601 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.602572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.603780 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.603765    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:12.617057 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.617030    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.719359 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.719325    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.820466 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.820416    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.921506 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:12.921472    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:12.974577 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.974547    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 11:40:12.974994 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:12.974722    2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 11:40:13.021628 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.021603    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.121829 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.121803    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.122428 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:13.122402    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6c8b6d42e5b52ab4cf9f706a9be0f7.slice/crio-57ab05037ed8620fabffc39ebbb95e391397ff134f4aa34441156add2725082d WatchSource:0}: Error finding container 57ab05037ed8620fabffc39ebbb95e391397ff134f4aa34441156add2725082d: Status 404 returned error can't find the container with id 57ab05037ed8620fabffc39ebbb95e391397ff134f4aa34441156add2725082d
Jul 07 11:40:13.122833 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:13.122814    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ccd326e5056db2ec15b8f22d5755cf.slice/crio-b085860daee608ecabacdc3a0d92bb2524a0420ef5d1842a170c2a26fa333995 WatchSource:0}: Error finding container b085860daee608ecabacdc3a0d92bb2524a0420ef5d1842a170c2a26fa333995: Status 404 returned error can't find the container with id b085860daee608ecabacdc3a0d92bb2524a0420ef5d1842a170c2a26fa333995
Jul 07 11:40:13.128391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.128375    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:40:13.140348 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.140316    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 11:35:12 +0000 UTC" deadline="2028-02-25 01:01:25.010407262 +0000 UTC"
Jul 07 11:40:13.140441 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.140349    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14341h21m11.870063272s"
Jul 07 11:40:13.170695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.170648    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"a9ccd326e5056db2ec15b8f22d5755cf","Type":"ContainerStarted","Data":"b085860daee608ecabacdc3a0d92bb2524a0420ef5d1842a170c2a26fa333995"}
Jul 07 11:40:13.171782 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.171761    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" event={"ID":"9b6c8b6d42e5b52ab4cf9f706a9be0f7","Type":"ContainerStarted","Data":"57ab05037ed8620fabffc39ebbb95e391397ff134f4aa34441156add2725082d"}
Jul 07 11:40:13.193845 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.193823    2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 11:40:13.194985 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.194969    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 11:40:13.195058 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.194997    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 11:40:13.195058 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.195007    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID"
Jul 07 11:40:13.222219 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.222196    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.265507 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.265475    2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:40:13.302371 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.302349    2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:40:13.322562 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.322537    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.424704 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.424646    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.525553 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:13.525530    2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found"
Jul 07 11:40:13.581777 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.581584    2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:40:13.632706 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.632686    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:13.646441 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.646284    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 11:40:13.647241 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.647037    2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"
Jul 07 11:40:13.658120 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:13.658034    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 11:40:14.015209 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.015180    2573 apiserver.go:52] "Watching apiserver"
Jul 07 11:40:14.022487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.022462    2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 11:40:14.022960 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.022933    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-lnm76","openshift-network-diagnostics/network-check-target-f2vwq","openshift-network-operator/iptables-alerter-xmn2m","openshift-ovn-kubernetes/ovnkube-node-cfhw6","kube-system/global-pull-secret-syncer-267gf","kube-system/konnectivity-agent-6wnc9","kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx","openshift-cluster-node-tuning-operator/tuned-st8fr","openshift-dns/node-resolver-647j8","openshift-multus/multus-jz5ms","openshift-multus/network-metrics-daemon-bfc7d","openshift-image-registry/node-ca-9js97","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal"]
Jul 07 11:40:14.024492 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.024469    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.025558 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.025538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.027164 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.027144    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.028334 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.028312    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.029039 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.028967    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.029039 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.028975    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 11:40:14.029218 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029102    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.029218 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029134    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.029330 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029249    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.029330 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029309    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xs2b2\""
Jul 07 11:40:14.029794 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029695    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 11:40:14.030189 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.029972    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.030189 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.030039    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:14.030189 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.030072    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.030189 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.030087    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-skxlr\""
Jul 07 11:40:14.030189 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.030111    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-68d5v\""
Jul 07 11:40:14.031635 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.031483    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.031856 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.031820    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.032447 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.032423    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 11:40:14.034541 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.032674    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 11:40:14.034541 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.032705    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.034541 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.033427    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 11:40:14.034541 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.033886    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.034541 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.034050    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 11:40:14.035873 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.034965    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.037161 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.036402    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.038113 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.038090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 11:40:14.038215 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.038144    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 11:40:14.039661 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.039517    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5n5qp\""
Jul 07 11:40:14.039661 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.039545    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 11:40:14.039661 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.039554    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.039885 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.039775    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-547k9\""
Jul 07 11:40:14.039976 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.039958    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:14.040082 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.040037    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:14.040353 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.040325    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8kbd\""
Jul 07 11:40:14.040990 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.040754    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.042061 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.041812    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t7cbk\""
Jul 07 11:40:14.042061 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.041948    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 11:40:14.042061 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.041982    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.042282 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.042199    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.043392 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043315    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.043522 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.043398    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:14.043598 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043526    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.043739 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043714    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.043839 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043802    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ee3855f-0211-4dbf-b404-0e381b9a8a81-host-slash\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.043901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.043901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043858    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-var-lib-kubelet\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.043901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043873    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130eef1e-7d34-44d6-9a77-f0505f0fdc34-serviceca\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.043901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043888    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-etc-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-netd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043920    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.043940    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9mpz\" (UniqueName: \"kubernetes.io/projected/2ee3855f-0211-4dbf-b404-0e381b9a8a81-kube-api-access-b9mpz\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044062    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-conf\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044098    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-log-socket\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044147    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044175    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-host\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044199    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-tuned\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-tmp\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49fed9bb-29e8-463a-b26f-d553bb99ca32-agent-certs\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044292    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49fed9bb-29e8-463a-b26f-d553bb99ca32-konnectivity-ca\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044344    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-kubernetes\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044391 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-systemd\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044417    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-run\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f00339e-0287-49c1-918e-3ae7eefc63f5-hosts-file\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ee3855f-0211-4dbf-b404-0e381b9a8a81-iptables-alerter-script\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044530    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysconfig\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpz4w\" (UniqueName: \"kubernetes.io/projected/7de6eedd-06d6-4109-8725-8bed24e73f85-kube-api-access-rpz4w\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130eef1e-7d34-44d6-9a77-f0505f0fdc34-host\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ptk2\" (UniqueName: \"kubernetes.io/projected/130eef1e-7d34-44d6-9a77-f0505f0fdc34-kube-api-access-2ptk2\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-kubelet\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-kubelet-config\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.044811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-systemd-units\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-var-lib-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044840    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-bin\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044864    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f00339e-0287-49c1-918e-3ae7eefc63f5-tmp-dir\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-dbus\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-sys\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-slash\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.044987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-systemd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-ovn\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-node-log\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045116    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5vd\" (UniqueName: \"kubernetes.io/projected/2f00339e-0287-49c1-918e-3ae7eefc63f5-kube-api-access-nb5vd\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-modprobe-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045163    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-lib-modules\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045195    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-config\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045220    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-script-lib\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6pk2\" (UniqueName: \"kubernetes.io/projected/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-kube-api-access-n6pk2\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-netns\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rqslb\""
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045314    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-env-overrides\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045840    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 11:40:14.045895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.045894    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 11:40:14.046263 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.046246    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzmr2\""
Jul 07 11:40:14.046628 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.046478    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 11:40:14.046628 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.046607    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 11:40:14.046831 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.046649    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 11:40:14.049202 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.049174    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 11:40:14.082038 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.082017    2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 11:40:14.133890 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.133869    2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 11:40:14.145574 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145550    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpz4w\" (UniqueName: \"kubernetes.io/projected/7de6eedd-06d6-4109-8725-8bed24e73f85-kube-api-access-rpz4w\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.145684 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145583    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.145684 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145610    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlknx\" (UniqueName: \"kubernetes.io/projected/33aa2fa4-4b97-4472-96e5-571d63404a9f-kube-api-access-vlknx\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.145684 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145633    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:14.145684 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjnz9\" (UniqueName: \"kubernetes.io/projected/f7270841-92d4-4c62-b476-17a56cbf4670-kube-api-access-kjnz9\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145703    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-var-lib-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145764    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-etc-selinux\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145770    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-var-lib-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145784    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145806    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-cnibin\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145833    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-os-release\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145863    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-socket-dir-parent\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.145918 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145905    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-config\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145980    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-multus\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.145999    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-device-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146018    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146040    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-os-release\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146090    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-var-lib-kubelet\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146130    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9mpz\" (UniqueName: \"kubernetes.io/projected/2ee3855f-0211-4dbf-b404-0e381b9a8a81-kube-api-access-b9mpz\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-log-socket\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146188    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146159    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-var-lib-kubelet\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146229    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-log-socket\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146285    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-registration-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146311    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-sys-fs\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.146332 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdnl7\" (UniqueName: \"kubernetes.io/projected/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kube-api-access-tdnl7\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146361    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cni-binary-copy\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146389    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-tuned\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146410    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-tmp\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49fed9bb-29e8-463a-b26f-d553bb99ca32-konnectivity-ca\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146458    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-systemd\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146477    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-ovn\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146500    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-node-log\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146534    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-bin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146570    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ee3855f-0211-4dbf-b404-0e381b9a8a81-iptables-alerter-script\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146582    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-config\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146599    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130eef1e-7d34-44d6-9a77-f0505f0fdc34-host\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/130eef1e-7d34-44d6-9a77-f0505f0fdc34-host\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146665    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-node-log\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-ovn\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146724    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-systemd\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146745    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ptk2\" (UniqueName: \"kubernetes.io/projected/130eef1e-7d34-44d6-9a77-f0505f0fdc34-kube-api-access-2ptk2\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.147053 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146737    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146773    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-kubelet\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146802    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-systemd-units\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146827    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-kubelet-config\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146852    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-bin\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-conf-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx82c\" (UniqueName: \"kubernetes.io/projected/ab882f1c-db28-4459-8f41-4ff9b2fa7589-kube-api-access-cx82c\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146943    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f00339e-0287-49c1-918e-3ae7eefc63f5-tmp-dir\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146969    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-dbus\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.146995    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-sys\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147047    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-systemd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147106    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-script-lib\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147188    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-kubelet\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147206    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49fed9bb-29e8-463a-b26f-d553bb99ca32-konnectivity-ca\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147225    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-systemd-units\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147270    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-sys\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147306    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-systemd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.147996 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-run-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147363    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-dbus\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147393    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-kubelet-config\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-socket-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147498    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5vd\" (UniqueName: \"kubernetes.io/projected/2f00339e-0287-49c1-918e-3ae7eefc63f5-kube-api-access-nb5vd\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147526    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-modprobe-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147646    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-bin\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f00339e-0287-49c1-918e-3ae7eefc63f5-tmp-dir\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147716    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovnkube-script-lib\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-lib-modules\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147783    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6pk2\" (UniqueName: \"kubernetes.io/projected/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-kube-api-access-n6pk2\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147806    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2ee3855f-0211-4dbf-b404-0e381b9a8a81-iptables-alerter-script\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147821    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-modprobe-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cnibin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147907    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-lib-modules\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-netns\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.148903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147971    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-kubelet\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.147999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-netns\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-env-overrides\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148061    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-system-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148068    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-netns\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148143    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ee3855f-0211-4dbf-b404-0e381b9a8a81-host-slash\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148160    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148191    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130eef1e-7d34-44d6-9a77-f0505f0fdc34-serviceca\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148216    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-etc-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148234    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2ee3855f-0211-4dbf-b404-0e381b9a8a81-host-slash\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148243    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-daemon-config\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148268    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148317    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-d\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148324    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-conf\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148377    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-etc-openvswitch\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148433    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.149738 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.148466    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-k8s-cni-cncf-io\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-hostroot\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-multus-certs\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.148563    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:14.64854164 +0000 UTC m=+2.978492194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148577    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-env-overrides\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.150604 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.148629    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-netd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.150981    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysctl-conf\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151000    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151065    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/130eef1e-7d34-44d6-9a77-f0505f0fdc34-serviceca\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151075    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-host\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151123    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49fed9bb-29e8-463a-b26f-d553bb99ca32-agent-certs\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151149    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-run-ovn-kubernetes\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151159    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-kubernetes\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151150    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-tmp\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-run\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151204    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-tuned\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151260 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151260    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-host\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151704    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-cni-netd\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.151886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151770    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-kubernetes\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.151886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151819    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-slash\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.151886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151834    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-run\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.152101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-host-slash\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.152101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151899    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-etc-kubernetes\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.152101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151956    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f00339e-0287-49c1-918e-3ae7eefc63f5-hosts-file\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.152101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.151994    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysconfig\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.152281 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.152142    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f00339e-0287-49c1-918e-3ae7eefc63f5-hosts-file\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.152281 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.152204    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7de6eedd-06d6-4109-8725-8bed24e73f85-etc-sysconfig\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.154433 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.154210    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49fed9bb-29e8-463a-b26f-d553bb99ca32-agent-certs\") pod \"konnectivity-agent-6wnc9\" (UID: \"49fed9bb-29e8-463a-b26f-d553bb99ca32\") " pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.155972 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.155937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-ovn-node-metrics-cert\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.157594 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.157544    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9mpz\" (UniqueName: \"kubernetes.io/projected/2ee3855f-0211-4dbf-b404-0e381b9a8a81-kube-api-access-b9mpz\") pod \"iptables-alerter-xmn2m\" (UID: \"2ee3855f-0211-4dbf-b404-0e381b9a8a81\") " pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.159440 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.159412    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpz4w\" (UniqueName: \"kubernetes.io/projected/7de6eedd-06d6-4109-8725-8bed24e73f85-kube-api-access-rpz4w\") pod \"tuned-st8fr\" (UID: \"7de6eedd-06d6-4109-8725-8bed24e73f85\") " pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.160933 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.160908    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ptk2\" (UniqueName: \"kubernetes.io/projected/130eef1e-7d34-44d6-9a77-f0505f0fdc34-kube-api-access-2ptk2\") pod \"node-ca-9js97\" (UID: \"130eef1e-7d34-44d6-9a77-f0505f0fdc34\") " pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.161550 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.161518    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5vd\" (UniqueName: \"kubernetes.io/projected/2f00339e-0287-49c1-918e-3ae7eefc63f5-kube-api-access-nb5vd\") pod \"node-resolver-647j8\" (UID: \"2f00339e-0287-49c1-918e-3ae7eefc63f5\") " pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.161941 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.161911    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6pk2\" (UniqueName: \"kubernetes.io/projected/3ad64b64-38ac-450a-b1ab-8dbd303c5f73-kube-api-access-n6pk2\") pod \"ovnkube-node-cfhw6\" (UID: \"3ad64b64-38ac-450a-b1ab-8dbd303c5f73\") " pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.183928 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.183902    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2tc9"
Jul 07 11:40:14.194269 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.194250    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b2tc9"
Jul 07 11:40:14.252837 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252807    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.252966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252849    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-multus\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.252966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252875    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-device-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.252966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.252966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252926    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.252966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252954    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-multus\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.252974    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-device-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-os-release\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253045    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-registration-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-sys-fs\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253116    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-os-release\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253142    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdnl7\" (UniqueName: \"kubernetes.io/projected/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kube-api-access-tdnl7\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253167    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cni-binary-copy\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253198    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-sys-fs\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253223    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-bin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253227 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253191    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-registration-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253274    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-conf-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253299    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx82c\" (UniqueName: \"kubernetes.io/projected/ab882f1c-db28-4459-8f41-4ff9b2fa7589-kube-api-access-cx82c\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253304    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-cni-bin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253327    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-socket-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253351    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253359    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-conf-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cnibin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253401    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-netns\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253425    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-kubelet\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253451    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-system-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253476    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253482    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cnibin\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-daemon-config\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253533    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253538    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253478    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-socket-dir\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.253944 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253591    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-system-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253606    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-k8s-cni-cncf-io\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253636    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-netns\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-hostroot\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253672    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-multus-certs\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253673    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-var-lib-kubelet\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253674    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-k8s-cni-cncf-io\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253701    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-etc-kubernetes\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253709    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-hostroot\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253735    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlknx\" (UniqueName: \"kubernetes.io/projected/33aa2fa4-4b97-4472-96e5-571d63404a9f-kube-api-access-vlknx\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253745    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33aa2fa4-4b97-4472-96e5-571d63404a9f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253761    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-etc-kubernetes\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253764    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.253796    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253815    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-cni-binary-copy\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253765    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-cni-dir\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.254651 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.253852    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:14.753835206 +0000 UTC m=+3.083785756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253798    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjnz9\" (UniqueName: \"kubernetes.io/projected/f7270841-92d4-4c62-b476-17a56cbf4670-kube-api-access-kjnz9\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253885    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-host-run-multus-certs\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253889    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-etc-selinux\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253925    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-cnibin\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253949    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-os-release\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.253973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-socket-dir-parent\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.254022    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-cnibin\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.254033    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33aa2fa4-4b97-4472-96e5-571d63404a9f-os-release\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.254050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-socket-dir-parent\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.254050    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1e979c46-88cd-47ad-a788-f0f57c0cb61b-etc-selinux\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.255268 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.254105    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab882f1c-db28-4459-8f41-4ff9b2fa7589-multus-daemon-config\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.263503 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.263476    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:14.263633 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.263522    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:14.263633 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.263537    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:14.263633 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.263609    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:14.763591136 +0000 UTC m=+3.093541689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:14.267910 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.267846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjnz9\" (UniqueName: \"kubernetes.io/projected/f7270841-92d4-4c62-b476-17a56cbf4670-kube-api-access-kjnz9\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.268158 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.268121    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlknx\" (UniqueName: \"kubernetes.io/projected/33aa2fa4-4b97-4472-96e5-571d63404a9f-kube-api-access-vlknx\") pod \"multus-additional-cni-plugins-lnm76\" (UID: \"33aa2fa4-4b97-4472-96e5-571d63404a9f\") " pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.268291 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.268239    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdnl7\" (UniqueName: \"kubernetes.io/projected/1e979c46-88cd-47ad-a788-f0f57c0cb61b-kube-api-access-tdnl7\") pod \"aws-ebs-csi-driver-node-shsfx\" (UID: \"1e979c46-88cd-47ad-a788-f0f57c0cb61b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.268373 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.268349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx82c\" (UniqueName: \"kubernetes.io/projected/ab882f1c-db28-4459-8f41-4ff9b2fa7589-kube-api-access-cx82c\") pod \"multus-jz5ms\" (UID: \"ab882f1c-db28-4459-8f41-4ff9b2fa7589\") " pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.340708 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.340674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-647j8"
Jul 07 11:40:14.354678 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.354653    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9js97"
Jul 07 11:40:14.365575 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.365534    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xmn2m"
Jul 07 11:40:14.373073 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.373055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:14.379729 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.379709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:14.387455 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.387436    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st8fr"
Jul 07 11:40:14.394118 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.394099    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx"
Jul 07 11:40:14.399551 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.399535    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lnm76"
Jul 07 11:40:14.400746 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.400728    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jz5ms"
Jul 07 11:40:14.420721 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.420704    2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 11:40:14.657448 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.657378    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:14.657629 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.657547    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:14.657629 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.657620    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:15.657602477 +0000 UTC m=+3.987553009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:14.758091 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.758058    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:14.758253 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.758216    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:14.758312 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.758285    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:15.7582679 +0000 UTC m=+4.088218451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:14.859129 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:14.859091    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:14.859282 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.859250    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:14.859282 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.859270    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:14.859380 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.859283    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:14.859380 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:14.859349    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:15.859328927 +0000 UTC m=+4.189279476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:15.082212 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.082179    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod130eef1e_7d34_44d6_9a77_f0505f0fdc34.slice/crio-2ff4e72a72525c400c4f207ce704794019781018460a27df629e04f759b18bab WatchSource:0}: Error finding container 2ff4e72a72525c400c4f207ce704794019781018460a27df629e04f759b18bab: Status 404 returned error can't find the container with id 2ff4e72a72525c400c4f207ce704794019781018460a27df629e04f759b18bab
Jul 07 11:40:15.085988 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.084966    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee3855f_0211_4dbf_b404_0e381b9a8a81.slice/crio-5261e0ad66b0e90837920e85b148f583cdbf7ef20c218101d266e282dde8987b WatchSource:0}: Error finding container 5261e0ad66b0e90837920e85b148f583cdbf7ef20c218101d266e282dde8987b: Status 404 returned error can't find the container with id 5261e0ad66b0e90837920e85b148f583cdbf7ef20c218101d266e282dde8987b
Jul 07 11:40:15.088426 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.088394    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad64b64_38ac_450a_b1ab_8dbd303c5f73.slice/crio-57c6912bbbeec97b6d4f080197c23c0afd96ca71a906ae37d0dec32b4a7cd75b WatchSource:0}: Error finding container 57c6912bbbeec97b6d4f080197c23c0afd96ca71a906ae37d0dec32b4a7cd75b: Status 404 returned error can't find the container with id 57c6912bbbeec97b6d4f080197c23c0afd96ca71a906ae37d0dec32b4a7cd75b
Jul 07 11:40:15.089667 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.089644    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33aa2fa4_4b97_4472_96e5_571d63404a9f.slice/crio-47fee6d8472dd82c1c38c8cab62f7cc01b1d3b9faf6fe7a843054b57a3b563f1 WatchSource:0}: Error finding container 47fee6d8472dd82c1c38c8cab62f7cc01b1d3b9faf6fe7a843054b57a3b563f1: Status 404 returned error can't find the container with id 47fee6d8472dd82c1c38c8cab62f7cc01b1d3b9faf6fe7a843054b57a3b563f1
Jul 07 11:40:15.090996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.090971    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f00339e_0287_49c1_918e_3ae7eefc63f5.slice/crio-5e3c1eb0256329557bb0b7d86cdd96a694fe9144ff08b7299e1017efd05b1d64 WatchSource:0}: Error finding container 5e3c1eb0256329557bb0b7d86cdd96a694fe9144ff08b7299e1017efd05b1d64: Status 404 returned error can't find the container with id 5e3c1eb0256329557bb0b7d86cdd96a694fe9144ff08b7299e1017efd05b1d64
Jul 07 11:40:15.091996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.091900    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de6eedd_06d6_4109_8725_8bed24e73f85.slice/crio-4017e144220bebfb5609eff7d2950b3d9dfb11805b8f70323ca301c4af348c52 WatchSource:0}: Error finding container 4017e144220bebfb5609eff7d2950b3d9dfb11805b8f70323ca301c4af348c52: Status 404 returned error can't find the container with id 4017e144220bebfb5609eff7d2950b3d9dfb11805b8f70323ca301c4af348c52
Jul 07 11:40:15.093324 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.093300    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e979c46_88cd_47ad_a788_f0f57c0cb61b.slice/crio-a53af1b0e70ba14b1691d7d6261f15efe820279d332114e4ab10797fb2c26d26 WatchSource:0}: Error finding container a53af1b0e70ba14b1691d7d6261f15efe820279d332114e4ab10797fb2c26d26: Status 404 returned error can't find the container with id a53af1b0e70ba14b1691d7d6261f15efe820279d332114e4ab10797fb2c26d26
Jul 07 11:40:15.095073 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:40:15.095040    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab882f1c_db28_4459_8f41_4ff9b2fa7589.slice/crio-f7f75be55274ab2a34eb6318ae4b609428647df5472a33492a8872b15c1141ca WatchSource:0}: Error finding container f7f75be55274ab2a34eb6318ae4b609428647df5472a33492a8872b15c1141ca: Status 404 returned error can't find the container with id f7f75be55274ab2a34eb6318ae4b609428647df5472a33492a8872b15c1141ca
Jul 07 11:40:15.176683 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.176652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" event={"ID":"9b6c8b6d42e5b52ab4cf9f706a9be0f7","Type":"ContainerStarted","Data":"5ce62d68fd538200f52e397d0fc655c7306b79bbee7c1125a24ff71a0cf8fb5f"}
Jul 07 11:40:15.177984 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.177830    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6wnc9" event={"ID":"49fed9bb-29e8-463a-b26f-d553bb99ca32","Type":"ContainerStarted","Data":"63373cba597a961c98ec85be04edd5093c2a5487decdd7d8812e637a0595bbb8"}
Jul 07 11:40:15.178986 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.178957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jz5ms" event={"ID":"ab882f1c-db28-4459-8f41-4ff9b2fa7589","Type":"ContainerStarted","Data":"f7f75be55274ab2a34eb6318ae4b609428647df5472a33492a8872b15c1141ca"}
Jul 07 11:40:15.180230 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.180202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-647j8" event={"ID":"2f00339e-0287-49c1-918e-3ae7eefc63f5","Type":"ContainerStarted","Data":"5e3c1eb0256329557bb0b7d86cdd96a694fe9144ff08b7299e1017efd05b1d64"}
Jul 07 11:40:15.181475 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.181418    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerStarted","Data":"47fee6d8472dd82c1c38c8cab62f7cc01b1d3b9faf6fe7a843054b57a3b563f1"}
Jul 07 11:40:15.182562 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.182538    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmn2m" event={"ID":"2ee3855f-0211-4dbf-b404-0e381b9a8a81","Type":"ContainerStarted","Data":"5261e0ad66b0e90837920e85b148f583cdbf7ef20c218101d266e282dde8987b"}
Jul 07 11:40:15.183762 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.183738    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx" event={"ID":"1e979c46-88cd-47ad-a788-f0f57c0cb61b","Type":"ContainerStarted","Data":"a53af1b0e70ba14b1691d7d6261f15efe820279d332114e4ab10797fb2c26d26"}
Jul 07 11:40:15.185613 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.185587    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st8fr" event={"ID":"7de6eedd-06d6-4109-8725-8bed24e73f85","Type":"ContainerStarted","Data":"4017e144220bebfb5609eff7d2950b3d9dfb11805b8f70323ca301c4af348c52"}
Jul 07 11:40:15.187185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.187163    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"57c6912bbbeec97b6d4f080197c23c0afd96ca71a906ae37d0dec32b4a7cd75b"}
Jul 07 11:40:15.188235 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.188216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9js97" event={"ID":"130eef1e-7d34-44d6-9a77-f0505f0fdc34","Type":"ContainerStarted","Data":"2ff4e72a72525c400c4f207ce704794019781018460a27df629e04f759b18bab"}
Jul 07 11:40:15.197198 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.197173    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:35:14 +0000 UTC" deadline="2028-02-28 00:48:45.674242717 +0000 UTC"
Jul 07 11:40:15.197198 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.197195    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14413h8m30.477050158s"
Jul 07 11:40:15.197972 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.197926    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" podStartSLOduration=2.197912574 podStartE2EDuration="2.197912574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:15.197722333 +0000 UTC m=+3.527672889" watchObservedRunningTime="2026-07-07 11:40:15.197912574 +0000 UTC m=+3.527863130"
Jul 07 11:40:15.663998 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.663258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:15.663998 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.663466    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:15.663998 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.663533    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:17.663513137 +0000 UTC m=+5.993463685 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:15.765557 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.764699    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:15.765557 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.764921    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:15.765557 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.764991    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:17.764971002 +0000 UTC m=+6.094921551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:15.865150 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:15.865111    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:15.865348 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.865274    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:15.865348 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.865295    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:15.865348 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.865309    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:15.865511 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:15.865371    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:17.865352647 +0000 UTC m=+6.195303198 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.168140    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.168143    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.168306    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:16.168397    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:16.168280    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:16.174640 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:16.168501    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:16.197893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.197816    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 11:35:14 +0000 UTC" deadline="2028-04-16 09:53:46.74607004 +0000 UTC"
Jul 07 11:40:16.197893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.197850    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15574h13m30.548224633s"
Jul 07 11:40:16.210323 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.209650    2573 generic.go:356] "Generic (PLEG): container finished" podID="a9ccd326e5056db2ec15b8f22d5755cf" containerID="d8f5a103daa90aa66e447960ebac2c05abdc296137db7f63f2302a539acc5a04" exitCode=0
Jul 07 11:40:16.210323 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:16.210123    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"a9ccd326e5056db2ec15b8f22d5755cf","Type":"ContainerDied","Data":"d8f5a103daa90aa66e447960ebac2c05abdc296137db7f63f2302a539acc5a04"}
Jul 07 11:40:17.230637 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:17.230011    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"a9ccd326e5056db2ec15b8f22d5755cf","Type":"ContainerStarted","Data":"2d426a86d2b2c47a99a3db2e15e4d8b35aef87663d354ad8e1081ad0a956be1e"}
Jul 07 11:40:17.249987 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:17.249507    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" podStartSLOduration=4.249486923 podStartE2EDuration="4.249486923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:17.249224681 +0000 UTC m=+5.579175237" watchObservedRunningTime="2026-07-07 11:40:17.249486923 +0000 UTC m=+5.579437481"
Jul 07 11:40:17.680481 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:17.680385    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:17.680685 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.680562    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:17.680685 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.680627    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:21.680607826 +0000 UTC m=+10.010558372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:17.781970 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:17.781285    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:17.781970 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.781453    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:17.781970 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.781609    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:21.781539353 +0000 UTC m=+10.111489886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:17.882739 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:17.882685    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:17.882924 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.882888    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:17.882924 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.882911    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:17.882924 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.882924    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:17.883097 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:17.882981    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:21.882963152 +0000 UTC m=+10.212913686 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:18.168684 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:18.168612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:18.168841 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:18.168737    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:18.168841 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:18.168739    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:18.168975 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:18.168859    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:18.168975 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:18.168614    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:18.168975 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:18.168943    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:20.168029 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:20.167944    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:20.168430 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:20.168125    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:20.168523 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:20.167945    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:20.168626 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:20.168600    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:20.168750 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:20.168635    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:20.168817 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:20.168794    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:21.713940 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:21.713898    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:21.714404 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.714061    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:21.714404 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.714138    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:29.714116253 +0000 UTC m=+18.044066787 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:21.814803 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:21.814759    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:21.815017 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.815000    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:21.815091 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.815065    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:29.815045393 +0000 UTC m=+18.144995939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:21.916770 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:21.916235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:21.916770 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.916396    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:21.916770 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.916413    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:21.916770 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.916426    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:21.916770 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:21.916486    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:29.916468278 +0000 UTC m=+18.246418831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:22.169035 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:22.168959    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:22.169214 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:22.169062    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:22.169214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:22.169097    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:22.169214 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:22.169129    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:22.169426 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:22.169219    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:22.169426 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:22.169319    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:24.168450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:24.168450    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:24.168613    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:24.168629    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:24.168736    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:24.168959 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:24.168820    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:26.168258 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:26.168224    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:26.168718 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:26.168239    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:26.168718 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:26.168348    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:26.168718 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:26.168346    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:26.168718 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:26.168426    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:26.168718 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:26.168523    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:28.168636 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:28.168594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:28.168636 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:28.168622    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:28.169263 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:28.168600    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:28.169263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:28.168721    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:28.169263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:28.168820    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:28.169263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:28.168904    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:29.773978 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:29.773890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:29.774379 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.774052    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:29.774379 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.774123    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:45.774101295 +0000 UTC m=+34.104051828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:29.874545 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:29.874511    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:29.874710 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.874661    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:29.874756 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.874732    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:40:45.874713522 +0000 UTC m=+34.204664052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:29.975291 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:29.975257    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:29.975445 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.975396    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:29.975445 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.975413    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:29.975445 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.975422    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:29.975605 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:29.975471    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:40:45.975456246 +0000 UTC m=+34.305406777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:30.168577 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:30.168481    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:30.168739 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:30.168507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:30.168739 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:30.168615    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:30.168739 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:30.168689    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:30.168739 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:30.168507    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:30.168929 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:30.168795    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:32.168753 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:32.168720    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:32.169157 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:32.168829    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:32.169157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:32.168924    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:32.169157 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:32.169046    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:32.169157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:32.169095    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:32.169329 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:32.169170    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:34.168245 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.167868    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:34.168947 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.167883    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:34.168947 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:34.168302    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:34.168947 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:34.168388    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:34.168947 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.167966    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:34.168947 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:34.168546    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:34.265008 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.264971    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6wnc9" event={"ID":"49fed9bb-29e8-463a-b26f-d553bb99ca32","Type":"ContainerStarted","Data":"15188a50043315edce7be51a62a7820f1bf34833f47ede08510db8f7ca5f446d"}
Jul 07 11:40:34.266637 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.266610    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jz5ms" event={"ID":"ab882f1c-db28-4459-8f41-4ff9b2fa7589","Type":"ContainerStarted","Data":"07d9f01cbb58e0be608e9ccacdc8f41196847fce6cd7ebec173f7f21c7b2ecce"}
Jul 07 11:40:34.268031 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.267999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-647j8" event={"ID":"2f00339e-0287-49c1-918e-3ae7eefc63f5","Type":"ContainerStarted","Data":"7299d4982689c140425a0f56463f502c7d22da0d3b43588a00f9ca5af5b88250"}
Jul 07 11:40:34.269592 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.269562    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="6b796cb593accb993eef93010064fa8c2b7a773fbf07676f7d9c822b08b88580" exitCode=0
Jul 07 11:40:34.269695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.269652    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"6b796cb593accb993eef93010064fa8c2b7a773fbf07676f7d9c822b08b88580"}
Jul 07 11:40:34.272275 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.272202    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx" event={"ID":"1e979c46-88cd-47ad-a788-f0f57c0cb61b","Type":"ContainerStarted","Data":"a66c790e8911d106bf1e9b477445104e399596de6b04fc21190805da406f5bfb"}
Jul 07 11:40:34.274783 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.274756    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st8fr" event={"ID":"7de6eedd-06d6-4109-8725-8bed24e73f85","Type":"ContainerStarted","Data":"7fe41ce38ef33d2c29886197bbc8e1abdc1842df8cbfc0a97a3981b14cb671dd"}
Jul 07 11:40:34.278104 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278080    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"2f3a8814709e9638e05c750ce6d19fa715cde94334c08e611abcb1bc87125eeb"}
Jul 07 11:40:34.278209 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278158    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"b83ea703dcb99d5998d07b7d2e71ed247fcf870c9ae56985217c0e563bfe4f43"}
Jul 07 11:40:34.278275 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278212    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"e3355bbec4d7b376461a87f93b6e8e32c7eb7144d2c78233b4d885d1fc49d582"}
Jul 07 11:40:34.278275 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278259    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"701fc49ba43a9892d28e2ee22663b29209b7adef532da697d2bb6107f92f6099"}
Jul 07 11:40:34.278376 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278305    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"b2d884eed4df0f3d3e9eaebb2a4dccd6b4f398ed4c96f82fc389c14986b40b6c"}
Jul 07 11:40:34.278376 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.278354    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"ac2aaa7d914f9e4de8edd4ee02d8ea3c647a029cbd06e45837072bfb906a93b0"}
Jul 07 11:40:34.279666 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.279641    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9js97" event={"ID":"130eef1e-7d34-44d6-9a77-f0505f0fdc34","Type":"ContainerStarted","Data":"351ee5c8b70bc09d47d25715990e74e85c0b334d3b140f32d2ac263b13e3ee9f"}
Jul 07 11:40:34.303668 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.303634    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6wnc9" podStartSLOduration=4.006805983 podStartE2EDuration="22.303621964s" totalImagesPullingTime="18.296815981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:34.286242179 +0000 UTC m=+22.616192732" watchObservedRunningTime="2026-07-07 11:40:34.303621964 +0000 UTC m=+22.633572499"
Jul 07 11:40:34.331973 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.331937    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-647j8" podStartSLOduration=4.028190066 podStartE2EDuration="22.331923846s" totalImagesPullingTime="18.30373378s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:34.305414518 +0000 UTC m=+22.635365070" watchObservedRunningTime="2026-07-07 11:40:34.331923846 +0000 UTC m=+22.661874448"
Jul 07 11:40:34.332109 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.332089    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9js97" podStartSLOduration=4.020850953 podStartE2EDuration="22.332083227s" totalImagesPullingTime="18.311232274s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:34.331591855 +0000 UTC m=+22.661542408" watchObservedRunningTime="2026-07-07 11:40:34.332083227 +0000 UTC m=+22.662033780"
Jul 07 11:40:34.388473 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.388415    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jz5ms" podStartSLOduration=4.035779287 podStartE2EDuration="22.388394732s" totalImagesPullingTime="18.352615445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:34.362039935 +0000 UTC m=+22.691990487" watchObservedRunningTime="2026-07-07 11:40:34.388394732 +0000 UTC m=+22.718345287"
Jul 07 11:40:34.415245 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.415193    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-st8fr" podStartSLOduration=4.114182197 podStartE2EDuration="22.415174518s" totalImagesPullingTime="18.300992321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:34.388557194 +0000 UTC m=+22.718507746" watchObservedRunningTime="2026-07-07 11:40:34.415174518 +0000 UTC m=+22.745125073"
Jul 07 11:40:34.537678 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.537643    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6wnc9_49fed9bb-29e8-463a-b26f-d553bb99ca32/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:34.628536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.628506    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6wnc9_49fed9bb-29e8-463a-b26f-d553bb99ca32/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:34.893100 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:34.893075    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 11:40:35.102099 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.101927    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T11:40:34.89309527Z","UUID":"d8395203-0fc2-4810-b1cb-ce0c502cdbe9","Handler":null,"Name":"","Endpoint":""}
Jul 07 11:40:35.103536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.103516    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 11:40:35.103662 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.103550    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 11:40:35.208739 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.208711    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:35.209459 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.209439    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:35.284108 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.284071    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xmn2m" event={"ID":"2ee3855f-0211-4dbf-b404-0e381b9a8a81","Type":"ContainerStarted","Data":"91ea8dd639e266c97f8b69927b46199c196a3760a3feb89d51aef418c15bb969"}
Jul 07 11:40:35.286426 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.286347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx" event={"ID":"1e979c46-88cd-47ad-a788-f0f57c0cb61b","Type":"ContainerStarted","Data":"ae6a2012a15f7bbefc21b6dc4679fc1cd0b064c38680c11eae0cd26624e94051"}
Jul 07 11:40:35.286879 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.286855    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:35.287430 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.287411    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6wnc9"
Jul 07 11:40:35.302455 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.302407    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xmn2m" podStartSLOduration=4.99007227 podStartE2EDuration="23.302394351s" totalImagesPullingTime="18.312322081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:35.301773088 +0000 UTC m=+23.631723641" watchObservedRunningTime="2026-07-07 11:40:35.302394351 +0000 UTC m=+23.632344906"
Jul 07 11:40:35.462045 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.461965    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6wnc9_49fed9bb-29e8-463a-b26f-d553bb99ca32/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:35.550408 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:35.550346    2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6wnc9_49fed9bb-29e8-463a-b26f-d553bb99ca32/konnectivity-agent/0.log" limit=1024
Jul 07 11:40:36.168375 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:36.168345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:36.168529 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:36.168345    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:36.168529 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:36.168349    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:36.168642 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:36.168508    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:36.168642 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:36.168569    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:36.168642 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:36.168625    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:36.291708 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:36.291675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx" event={"ID":"1e979c46-88cd-47ad-a788-f0f57c0cb61b","Type":"ContainerStarted","Data":"1379b3c7a5627763cc781f182dfa524f39a24ffb9736c1db1ee81193445cbf42"}
Jul 07 11:40:36.296571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:36.296546    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"de4d328915728a87d8596b31c4fe81da4000565ea4a562acc70832ebb0ae0af7"}
Jul 07 11:40:38.168628 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:38.168405    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:38.169077 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:38.168407    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:38.169077 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:38.168713    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:38.169077 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:38.168410    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:38.169077 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:38.168840    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:38.169077 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:38.168932    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:39.303922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.303727    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="9a43bd391620fd610bb33d7cc8717a5bf3e372213aaf09eb9ae5e5edbb3ce455" exitCode=0
Jul 07 11:40:39.304716 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.303808    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"9a43bd391620fd610bb33d7cc8717a5bf3e372213aaf09eb9ae5e5edbb3ce455"}
Jul 07 11:40:39.307525 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.307486    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" event={"ID":"3ad64b64-38ac-450a-b1ab-8dbd303c5f73","Type":"ContainerStarted","Data":"c3a1018e9c591540f92c6fa547232a546d2cfbfb897a4f5e7477d07141252f71"}
Jul 07 11:40:39.307738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.307726    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:39.307792 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.307776    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:39.322869 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.322849    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:39.336470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.336433    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-shsfx" podStartSLOduration=6.96173714 podStartE2EDuration="27.336420595s" totalImagesPullingTime="20.374683455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:36.311882443 +0000 UTC m=+24.641832997" watchObservedRunningTime="2026-07-07 11:40:39.336420595 +0000 UTC m=+27.666371125"
Jul 07 11:40:39.372063 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:39.372025    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6" podStartSLOduration=9.001735241 podStartE2EDuration="27.372013479s" totalImagesPullingTime="18.370278238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:39.371743766 +0000 UTC m=+27.701694322" watchObservedRunningTime="2026-07-07 11:40:39.372013479 +0000 UTC m=+27.701964042"
Jul 07 11:40:40.168405 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.168329    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:40.168766 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.168339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:40.168766 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.168427    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:40.168766 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.168339    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:40.168766 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.168507    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:40.168766 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.168590    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:40.310133 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.310111    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:40.323953 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.323936    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:40:40.639205 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.639170    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f2vwq"]
Jul 07 11:40:40.639585 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.639318    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:40.639585 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.639423    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:40.655071 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.655042    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-267gf"]
Jul 07 11:40:40.655178 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.655148    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:40.655274 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.655253    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:40.655655 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.655636    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfc7d"]
Jul 07 11:40:40.655730 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:40.655719    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:40.655803 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:40.655788    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:41.313894 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:41.313863    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="5ccfc1db5a0586b5317692b72dae25e7fbb2e7beb586db1186602bef49ac7e90" exitCode=0
Jul 07 11:40:41.314399 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:41.313943    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"5ccfc1db5a0586b5317692b72dae25e7fbb2e7beb586db1186602bef49ac7e90"}
Jul 07 11:40:41.460869 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:41.460849    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-647j8_2f00339e-0287-49c1-918e-3ae7eefc63f5/dns-node-resolver/0.log"
Jul 07 11:40:42.168952 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:42.168922    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:42.169111 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:42.168995    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:42.169111 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:42.169073    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:42.169191 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:42.169169    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:42.169228 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:42.169206    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:42.169264 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:42.169254    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:42.249181 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:42.249158    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9js97_130eef1e-7d34-44d6-9a77-f0505f0fdc34/node-ca/0.log"
Jul 07 11:40:43.322407 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:43.322239    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="bd5821972fe54a8ee089c3438631a41e7f001e9c204a41b64dabbff0a26cd4b5" exitCode=0
Jul 07 11:40:43.322777 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:43.322314    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"bd5821972fe54a8ee089c3438631a41e7f001e9c204a41b64dabbff0a26cd4b5"}
Jul 07 11:40:44.168134 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:44.168055    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:44.168134 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:44.168082    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:44.168336 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:44.168058    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:44.168336 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:44.168187    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:44.168336 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:44.168256    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:44.168478 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:44.168344    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:45.793351 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:45.793316    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:45.793816 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.793434    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:45.793816 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.793518    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret podName:c8f39cb0-9ed5-407f-bc24-4d5a50629eb8 nodeName:}" failed. No retries permitted until 2026-07-07 11:41:17.793486243 +0000 UTC m=+66.123436775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret") pod "global-pull-secret-syncer-267gf" (UID: "c8f39cb0-9ed5-407f-bc24-4d5a50629eb8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 11:40:45.893995 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:45.893964    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:45.894167 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.894067    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:45.894167 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.894141    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs podName:f7270841-92d4-4c62-b476-17a56cbf4670 nodeName:}" failed. No retries permitted until 2026-07-07 11:41:17.894121715 +0000 UTC m=+66.224072267 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs") pod "network-metrics-daemon-bfc7d" (UID: "f7270841-92d4-4c62-b476-17a56cbf4670") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 11:40:45.995233 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:45.995203    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:45.995396 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.995337    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 11:40:45.995396 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.995352    2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 11:40:45.995396 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.995361    2573 projected.go:196] Error preparing data for projected volume kube-api-access-7gvqh for pod openshift-network-diagnostics/network-check-target-f2vwq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:45.995553 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:45.995411    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh podName:e8447192-4f91-4dcb-be7d-00eb51811bcd nodeName:}" failed. No retries permitted until 2026-07-07 11:41:17.995394779 +0000 UTC m=+66.325345311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gvqh" (UniqueName: "kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh") pod "network-check-target-f2vwq" (UID: "e8447192-4f91-4dcb-be7d-00eb51811bcd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 11:40:46.168025 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:46.167929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:46.168025 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:46.167949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:46.168232 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:46.168041    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:46.168232 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:46.168108    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:46.168232 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:46.168161    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:46.168384 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:46.168259    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:47.333748 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:47.333714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerStarted","Data":"5856cdb275f25fc1087b3a9c66ab3a24d05d8ee1299be01f1af4a70fd3f89618"}
Jul 07 11:40:48.168014 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:48.167986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:48.168159 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:48.167986    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:48.168159 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:48.168074    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:48.168159 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:48.167993    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:48.168159 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:48.168149    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:48.168397 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:48.168253    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:48.338408 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:48.338377    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="5856cdb275f25fc1087b3a9c66ab3a24d05d8ee1299be01f1af4a70fd3f89618" exitCode=0
Jul 07 11:40:48.338846 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:48.338428    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"5856cdb275f25fc1087b3a9c66ab3a24d05d8ee1299be01f1af4a70fd3f89618"}
Jul 07 11:40:49.343085 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:49.343045    2573 generic.go:356] "Generic (PLEG): container finished" podID="33aa2fa4-4b97-4472-96e5-571d63404a9f" containerID="24e618b37a2f92aebf584724cb4bd73aaa220de464f3d98f9b87a452533f2a21" exitCode=0
Jul 07 11:40:49.343560 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:49.343105    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerDied","Data":"24e618b37a2f92aebf584724cb4bd73aaa220de464f3d98f9b87a452533f2a21"}
Jul 07 11:40:50.167817 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:50.167785    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:50.167817 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:50.167804    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:50.168039 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:50.167790    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:50.168039 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:50.167928    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:50.168184 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:50.168094    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:50.168246 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:50.168202    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:50.349055 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:50.348981    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm76" event={"ID":"33aa2fa4-4b97-4472-96e5-571d63404a9f","Type":"ContainerStarted","Data":"26bf3814dc17b0e6d83db022eabe1abbfcb68f55a1423a6a568055cd79ec211e"}
Jul 07 11:40:50.379089 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:50.379043    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lnm76" podStartSLOduration=9.884466739 podStartE2EDuration="38.379029533s" totalImagesPullingTime="28.494562794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:40:50.377889968 +0000 UTC m=+38.707840534" watchObservedRunningTime="2026-07-07 11:40:50.379029533 +0000 UTC m=+38.708980086"
Jul 07 11:40:52.168664 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:52.168630    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:52.169017 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:52.168703    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:52.169017 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:52.168811    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:52.169017 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:52.168930    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:52.169017 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:52.168978    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:52.169146 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:52.169053    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:54.167804 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:54.167779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:54.168263 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:54.167779    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:54.168263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:54.167901    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:54.168263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:54.167976    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:54.168263 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:54.168016    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:54.168263 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:54.168068    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:56.167950 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:56.167921    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:56.168318 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:56.167929    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:56.168318 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:56.168016    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:56.168318 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:56.168031    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:56.168318 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:56.168115    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:40:56.168318 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:56.168195    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:58.167983 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:58.167948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:40:58.168549 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:58.167948    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:40:58.168549 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:58.168045    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:40:58.168549 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:58.168146    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:40:58.168549 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:40:58.167956    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:40:58.168549 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:40:58.168258    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:41:00.168344 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:00.168314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:00.168785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:00.168314    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:00.168785 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:00.168430    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:41:00.168785 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:00.168519    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:41:00.168785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:00.168545    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:00.168785 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:00.168645    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:41:02.168639 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:02.168602    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:02.169081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:02.168674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:02.169081 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:02.168692    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:41:02.169081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:02.168778    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:02.169081 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:02.168789    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:41:02.169081 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:02.168878    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:41:04.167986 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:04.167954    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:04.168360 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:04.167960    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:04.168360 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:04.168049    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:41:04.168360 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:04.167964    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:04.168360 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:04.168120    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:41:04.168360 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:04.168196    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:41:06.168571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:06.168538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:06.168571 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:06.168570    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:06.169123 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:06.168538    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:06.169123 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:06.168662    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bfc7d" podUID="f7270841-92d4-4c62-b476-17a56cbf4670"
Jul 07 11:41:06.169123 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:06.168708    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f2vwq" podUID="e8447192-4f91-4dcb-be7d-00eb51811bcd"
Jul 07 11:41:06.169123 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:41:06.168785    2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-267gf" podUID="c8f39cb0-9ed5-407f-bc24-4d5a50629eb8"
Jul 07 11:41:07.924624 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:07.924605    2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeReady"
Jul 07 11:41:07.924927 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:07.924719    2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 11:41:08.023580 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.023554    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fdf547d95-6t4wn"]
Jul 07 11:41:08.037449 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.037432    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064449 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064426    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-trusted-ca\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-image-registry-private-configuration\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd8facfc-8366-46be-aa6d-79db712519f5-ca-trust-extracted\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-installation-pull-secrets\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4j6\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-kube-api-access-4v4j6\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064548    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-bound-sa-token\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064564    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-registry-tls\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.064676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.064592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-registry-certificates\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.093001 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.092979    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 11:41:08.101237 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.101222    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 11:41:08.103845 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.103830    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pcfw9\""
Jul 07 11:41:08.104282 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.104269    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 11:41:08.136487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.136466    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xt447"]
Jul 07 11:41:08.154269 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.154220    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdf547d95-6t4wn"]
Jul 07 11:41:08.154345 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.154313    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165272 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165254    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-trusted-ca\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165280    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-image-registry-private-configuration\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165297    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd8facfc-8366-46be-aa6d-79db712519f5-ca-trust-extracted\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmn9\" (UniqueName: \"kubernetes.io/projected/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-api-access-8cmn9\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165359    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-installation-pull-secrets\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165382    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4j6\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-kube-api-access-4v4j6\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165407    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-bound-sa-token\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165430    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b832c7bf-5efe-494c-a09f-3ad8d444b52b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165460    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-registry-tls\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165508    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-registry-certificates\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b832c7bf-5efe-494c-a09f-3ad8d444b52b-crio-socket\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b832c7bf-5efe-494c-a09f-3ad8d444b52b-data-volume\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.165765 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.165668    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cd8facfc-8366-46be-aa6d-79db712519f5-ca-trust-extracted\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.166179 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.166161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-registry-certificates\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.168557 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.168537    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:08.168557 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.168552    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:08.168699 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.168566    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:08.169724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.169706    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-installation-pull-secrets\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.169817 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.169722    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cd8facfc-8366-46be-aa6d-79db712519f5-image-registry-private-configuration\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.169817 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.169727    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-registry-tls\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.226594 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.226571    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 11:41:08.226706 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.226648    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 11:41:08.226706 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.226693    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 11:41:08.227125 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.227107    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 11:41:08.227291 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.227276    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xt447"]
Jul 07 11:41:08.227484 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.227469    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 11:41:08.227484 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.227483    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 11:41:08.227649 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.227601    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 11:41:08.228643 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.228624    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-t6ln8\""
Jul 07 11:41:08.229020 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.229006    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vsqg\""
Jul 07 11:41:08.229505 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.229478    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z7ksr\""
Jul 07 11:41:08.229584 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.229571    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 11:41:08.231482 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.231464    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 11:41:08.231938 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.231919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4j6\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-kube-api-access-4v4j6\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.236879 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.236857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cd8facfc-8366-46be-aa6d-79db712519f5-trusted-ca\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.236989 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.236975    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-84pw6"]
Jul 07 11:41:08.259770 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.259749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cd8facfc-8366-46be-aa6d-79db712519f5-bound-sa-token\") pod \"image-registry-7fdf547d95-6t4wn\" (UID: \"cd8facfc-8366-46be-aa6d-79db712519f5\") " pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.266027 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266009    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b832c7bf-5efe-494c-a09f-3ad8d444b52b-data-volume\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266118 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266062    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266202 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266182    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmn9\" (UniqueName: \"kubernetes.io/projected/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-api-access-8cmn9\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266259 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b832c7bf-5efe-494c-a09f-3ad8d444b52b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266309 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266289    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b832c7bf-5efe-494c-a09f-3ad8d444b52b-crio-socket\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266363 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b832c7bf-5efe-494c-a09f-3ad8d444b52b-data-volume\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266439 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266421    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b832c7bf-5efe-494c-a09f-3ad8d444b52b-crio-socket\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.266740 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.266725    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.268196 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.268182    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.268310 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.268293    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b832c7bf-5efe-494c-a09f-3ad8d444b52b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.280210 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.280191    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 11:41:08.280342 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.280322    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xzh75\""
Jul 07 11:41:08.282181 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.282163    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84pw6"]
Jul 07 11:41:08.292929 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.292914    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 11:41:08.296695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.296677    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmn9\" (UniqueName: \"kubernetes.io/projected/b832c7bf-5efe-494c-a09f-3ad8d444b52b-kube-api-access-8cmn9\") pod \"insights-runtime-extractor-xt447\" (UID: \"b832c7bf-5efe-494c-a09f-3ad8d444b52b\") " pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.321148 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.321125    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 11:41:08.343805 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.343780    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8b77h"]
Jul 07 11:41:08.345750 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.345717    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:08.365204 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.365185    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.367653 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.367632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx94x\" (UniqueName: \"kubernetes.io/projected/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-kube-api-access-sx94x\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.367732 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.367701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-cert\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.371800 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.371782    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 11:41:08.372078 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.372060    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 11:41:08.372544 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.372526    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pn956\""
Jul 07 11:41:08.417785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.417722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8b77h"]
Jul 07 11:41:08.463081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.463053    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xt447"
Jul 07 11:41:08.468406 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cea6405-788c-4407-a788-1e71b21add88-config-volume\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.468566 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468447    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx94x\" (UniqueName: \"kubernetes.io/projected/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-kube-api-access-sx94x\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.468566 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxmpg\" (UniqueName: \"kubernetes.io/projected/1cea6405-788c-4407-a788-1e71b21add88-kube-api-access-gxmpg\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.468566 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cea6405-788c-4407-a788-1e71b21add88-tmp-dir\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.468681 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468578    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-cert\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.468681 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.468642    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cea6405-788c-4407-a788-1e71b21add88-metrics-tls\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.470682 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.470657    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-cert\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.522422 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.522397    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx94x\" (UniqueName: \"kubernetes.io/projected/d3880cb2-fbd5-43d6-ad51-af927bd3c4f1-kube-api-access-sx94x\") pod \"ingress-canary-84pw6\" (UID: \"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1\") " pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.559847 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.559820    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fdf547d95-6t4wn"]
Jul 07 11:41:08.565196 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:08.563309    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8facfc_8366_46be_aa6d_79db712519f5.slice/crio-9f98155faf623c429abd476183fec917fdefea1e8224566695a1d4c197be02e8 WatchSource:0}: Error finding container 9f98155faf623c429abd476183fec917fdefea1e8224566695a1d4c197be02e8: Status 404 returned error can't find the container with id 9f98155faf623c429abd476183fec917fdefea1e8224566695a1d4c197be02e8
Jul 07 11:41:08.569157 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569138    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cea6405-788c-4407-a788-1e71b21add88-tmp-dir\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.569240 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569226    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cea6405-788c-4407-a788-1e71b21add88-metrics-tls\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.569303 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569258    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cea6405-788c-4407-a788-1e71b21add88-config-volume\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.569303 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569304    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxmpg\" (UniqueName: \"kubernetes.io/projected/1cea6405-788c-4407-a788-1e71b21add88-kube-api-access-gxmpg\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.569483 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cea6405-788c-4407-a788-1e71b21add88-tmp-dir\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.569809 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.569789    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cea6405-788c-4407-a788-1e71b21add88-config-volume\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.571258 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.571240    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cea6405-788c-4407-a788-1e71b21add88-metrics-tls\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.579685 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.579663    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-84pw6"
Jul 07 11:41:08.588163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.588115    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxmpg\" (UniqueName: \"kubernetes.io/projected/1cea6405-788c-4407-a788-1e71b21add88-kube-api-access-gxmpg\") pod \"dns-default-8b77h\" (UID: \"1cea6405-788c-4407-a788-1e71b21add88\") " pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.644205 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.644161    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xt447"]
Jul 07 11:41:08.647555 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:08.647517    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb832c7bf_5efe_494c_a09f_3ad8d444b52b.slice/crio-4afbf43b1bf26ec0486753cecdc8e926c06f6d5d3be89320e4d5b98938c6e4f3 WatchSource:0}: Error finding container 4afbf43b1bf26ec0486753cecdc8e926c06f6d5d3be89320e4d5b98938c6e4f3: Status 404 returned error can't find the container with id 4afbf43b1bf26ec0486753cecdc8e926c06f6d5d3be89320e4d5b98938c6e4f3
Jul 07 11:41:08.674063 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.674008    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:08.753593 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.753544    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-84pw6"]
Jul 07 11:41:08.757506 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:08.757474    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3880cb2_fbd5_43d6_ad51_af927bd3c4f1.slice/crio-b4ab9e6154e7f7446d260e798bd6405d43a9103605410f555bbaf232f99be00f WatchSource:0}: Error finding container b4ab9e6154e7f7446d260e798bd6405d43a9103605410f555bbaf232f99be00f: Status 404 returned error can't find the container with id b4ab9e6154e7f7446d260e798bd6405d43a9103605410f555bbaf232f99be00f
Jul 07 11:41:08.832714 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.832682    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8b77h"]
Jul 07 11:41:08.833382 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.833236    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"]
Jul 07 11:41:08.835599 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:08.835576    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cea6405_788c_4407_a788_1e71b21add88.slice/crio-89c56bbdb5597f03b6a736c9bdb76721b6d8ee6d632205173aa693b95172561c WatchSource:0}: Error finding container 89c56bbdb5597f03b6a736c9bdb76721b6d8ee6d632205173aa693b95172561c: Status 404 returned error can't find the container with id 89c56bbdb5597f03b6a736c9bdb76721b6d8ee6d632205173aa693b95172561c
Jul 07 11:41:08.840611 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.840594    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:08.844110 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.844090    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-55mn2\""
Jul 07 11:41:08.844269 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.844253    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 11:41:08.851253 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.851232    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"]
Jul 07 11:41:08.871975 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.871953    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55f4f97d-52ff-47f3-8643-e193d8856aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-d5t76\" (UID: \"55f4f97d-52ff-47f3-8643-e193d8856aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:08.972279 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.972244    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55f4f97d-52ff-47f3-8643-e193d8856aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-d5t76\" (UID: \"55f4f97d-52ff-47f3-8643-e193d8856aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:08.974529 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:08.974481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/55f4f97d-52ff-47f3-8643-e193d8856aa2-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-d5t76\" (UID: \"55f4f97d-52ff-47f3-8643-e193d8856aa2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:09.149873 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.149833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:09.370068 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.370036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"]
Jul 07 11:41:09.376730 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:09.376687    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f4f97d_52ff_47f3_8643_e193d8856aa2.slice/crio-249e2a5d3c7925e3ca4c6244f539e2e2d90f9b5fb43fc3c6f03c45a41347f108 WatchSource:0}: Error finding container 249e2a5d3c7925e3ca4c6244f539e2e2d90f9b5fb43fc3c6f03c45a41347f108: Status 404 returned error can't find the container with id 249e2a5d3c7925e3ca4c6244f539e2e2d90f9b5fb43fc3c6f03c45a41347f108
Jul 07 11:41:09.392806 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.392773    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76" event={"ID":"55f4f97d-52ff-47f3-8643-e193d8856aa2","Type":"ContainerStarted","Data":"249e2a5d3c7925e3ca4c6244f539e2e2d90f9b5fb43fc3c6f03c45a41347f108"}
Jul 07 11:41:09.395891 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.395865    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b77h" event={"ID":"1cea6405-788c-4407-a788-1e71b21add88","Type":"ContainerStarted","Data":"89c56bbdb5597f03b6a736c9bdb76721b6d8ee6d632205173aa693b95172561c"}
Jul 07 11:41:09.398363 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.398315    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt447" event={"ID":"b832c7bf-5efe-494c-a09f-3ad8d444b52b","Type":"ContainerStarted","Data":"4afbf43b1bf26ec0486753cecdc8e926c06f6d5d3be89320e4d5b98938c6e4f3"}
Jul 07 11:41:09.402087 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.402061    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn" event={"ID":"cd8facfc-8366-46be-aa6d-79db712519f5","Type":"ContainerStarted","Data":"99e347431ad45247a39203b64470824d4042569bedc7f31de801a8ce44b25d50"}
Jul 07 11:41:09.402185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.402107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn" event={"ID":"cd8facfc-8366-46be-aa6d-79db712519f5","Type":"ContainerStarted","Data":"9f98155faf623c429abd476183fec917fdefea1e8224566695a1d4c197be02e8"}
Jul 07 11:41:09.402310 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.402292    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:09.406738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.406714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84pw6" event={"ID":"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1","Type":"ContainerStarted","Data":"b4ab9e6154e7f7446d260e798bd6405d43a9103605410f555bbaf232f99be00f"}
Jul 07 11:41:09.446412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:09.446362    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn" podStartSLOduration=2.446342478 podStartE2EDuration="2.446342478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:09.443732882 +0000 UTC m=+57.773683442" watchObservedRunningTime="2026-07-07 11:41:09.446342478 +0000 UTC m=+57.776293032"
Jul 07 11:41:12.329322 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:12.329293    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cfhw6"
Jul 07 11:41:14.422149 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.422103    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76" event={"ID":"55f4f97d-52ff-47f3-8643-e193d8856aa2","Type":"ContainerStarted","Data":"ea18693f531829499523ef8244d709274ed3c31712ab68cf8c5cfaf3e0f3aee0"}
Jul 07 11:41:14.422633 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.422325    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:14.424248 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.424220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b77h" event={"ID":"1cea6405-788c-4407-a788-1e71b21add88","Type":"ContainerStarted","Data":"5c5a87690f32b3c272f2443c0338bbf48c8fa48a808fe3e302dc9333f0327cc1"}
Jul 07 11:41:14.424385 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.424268    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8b77h" event={"ID":"1cea6405-788c-4407-a788-1e71b21add88","Type":"ContainerStarted","Data":"19a1cd5f0385da94780efd8d41b2cdc95c8562140d7c22337ad331eeaacde121"}
Jul 07 11:41:14.424468 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.424451    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:14.426090 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.426066    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt447" event={"ID":"b832c7bf-5efe-494c-a09f-3ad8d444b52b","Type":"ContainerStarted","Data":"beda253da8a5ee31068b51d33a89458ebafb265badf54c5ab415751b376432a4"}
Jul 07 11:41:14.427945 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.427926    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-84pw6" event={"ID":"d3880cb2-fbd5-43d6-ad51-af927bd3c4f1","Type":"ContainerStarted","Data":"3b9bc908c3d8967a251e11cc5c956988ed1be20ef9b0570985bcdf7e7720a80f"}
Jul 07 11:41:14.428356 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.428336    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76"
Jul 07 11:41:14.454140 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.454103    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-d5t76" podStartSLOduration=1.966356041 podStartE2EDuration="6.454091696s" totalImagesPullingTime="4.487735655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:14.453762186 +0000 UTC m=+62.783712740" watchObservedRunningTime="2026-07-07 11:41:14.454091696 +0000 UTC m=+62.784042226"
Jul 07 11:41:14.535844 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.535804    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-84pw6" podStartSLOduration=1.426937501 podStartE2EDuration="6.535790077s" totalImagesPullingTime="5.108852576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:14.535663246 +0000 UTC m=+62.865613800" watchObservedRunningTime="2026-07-07 11:41:14.535790077 +0000 UTC m=+62.865740630"
Jul 07 11:41:14.637713 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:14.637661    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8b77h" podStartSLOduration=1.606567764 podStartE2EDuration="6.637645735s" totalImagesPullingTime="5.031077971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:14.613573513 +0000 UTC m=+62.943524066" watchObservedRunningTime="2026-07-07 11:41:14.637645735 +0000 UTC m=+62.967596286"
Jul 07 11:41:15.434184 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:15.433923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt447" event={"ID":"b832c7bf-5efe-494c-a09f-3ad8d444b52b","Type":"ContainerStarted","Data":"184616802e50a2ae3c4cf2cc4d4b9dd612cea398366ffff913e53728a6111c2c"}
Jul 07 11:41:17.443851 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.443823    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xt447" event={"ID":"b832c7bf-5efe-494c-a09f-3ad8d444b52b","Type":"ContainerStarted","Data":"b052a90cc5c7fbbfebe139d58cb319a9a1775452b5fb6ef3dcb21d5604eda7ca"}
Jul 07 11:41:17.486388 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.486344    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xt447" podStartSLOduration=1.357651989 podStartE2EDuration="9.486331426s" totalImagesPullingTime="8.128679437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:41:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:17.485028881 +0000 UTC m=+65.814979434" watchObservedRunningTime="2026-07-07 11:41:17.486331426 +0000 UTC m=+65.816281978"
Jul 07 11:41:17.843171 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.843103    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:17.847161 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.847145    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 11:41:17.856108 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.856085    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c8f39cb0-9ed5-407f-bc24-4d5a50629eb8-original-pull-secret\") pod \"global-pull-secret-syncer-267gf\" (UID: \"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8\") " pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:17.944060 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.944035    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:17.946816 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.946800    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 11:41:17.956699 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:17.956671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f7270841-92d4-4c62-b476-17a56cbf4670-metrics-certs\") pod \"network-metrics-daemon-bfc7d\" (UID: \"f7270841-92d4-4c62-b476-17a56cbf4670\") " pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:18.045102 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.045070    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:18.048345 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.048329    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 11:41:18.059238 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.059223    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 11:41:18.068190 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.068167    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gvqh\" (UniqueName: \"kubernetes.io/projected/e8447192-4f91-4dcb-be7d-00eb51811bcd-kube-api-access-7gvqh\") pod \"network-check-target-f2vwq\" (UID: \"e8447192-4f91-4dcb-be7d-00eb51811bcd\") " pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:18.087316 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.087298    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5vsqg\""
Jul 07 11:41:18.089422 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.089409    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-267gf"
Jul 07 11:41:18.093298 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.093265    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bfc7d"
Jul 07 11:41:18.099595 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.099572    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z7ksr\""
Jul 07 11:41:18.103685 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.103659    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:18.284891 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.284868    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-267gf"]
Jul 07 11:41:18.285961 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:18.285934    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f39cb0_9ed5_407f_bc24_4d5a50629eb8.slice/crio-44bbb19e5757e32f26bfb15d1d9163ca1a957f7d13c8ccd97b016da9c36f1ea0 WatchSource:0}: Error finding container 44bbb19e5757e32f26bfb15d1d9163ca1a957f7d13c8ccd97b016da9c36f1ea0: Status 404 returned error can't find the container with id 44bbb19e5757e32f26bfb15d1d9163ca1a957f7d13c8ccd97b016da9c36f1ea0
Jul 07 11:41:18.447648 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.447611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-267gf" event={"ID":"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8","Type":"ContainerStarted","Data":"44bbb19e5757e32f26bfb15d1d9163ca1a957f7d13c8ccd97b016da9c36f1ea0"}
Jul 07 11:41:18.491826 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.491798    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f2vwq"]
Jul 07 11:41:18.492542 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:18.492519    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bfc7d"]
Jul 07 11:41:18.498960 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:18.498938    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7270841_92d4_4c62_b476_17a56cbf4670.slice/crio-85ca8b5c05c0b5a9a8dc2d90b1d7931f027267d3244ed6ba490f24f5a9dfcf30 WatchSource:0}: Error finding container 85ca8b5c05c0b5a9a8dc2d90b1d7931f027267d3244ed6ba490f24f5a9dfcf30: Status 404 returned error can't find the container with id 85ca8b5c05c0b5a9a8dc2d90b1d7931f027267d3244ed6ba490f24f5a9dfcf30
Jul 07 11:41:18.499420 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:18.499398    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8447192_4f91_4dcb_be7d_00eb51811bcd.slice/crio-7c08de3194d7094c5479e1494998c1dc132586044f2e3c8eefde59c4c9880103 WatchSource:0}: Error finding container 7c08de3194d7094c5479e1494998c1dc132586044f2e3c8eefde59c4c9880103: Status 404 returned error can't find the container with id 7c08de3194d7094c5479e1494998c1dc132586044f2e3c8eefde59c4c9880103
Jul 07 11:41:19.453837 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:19.453778    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f2vwq" event={"ID":"e8447192-4f91-4dcb-be7d-00eb51811bcd","Type":"ContainerStarted","Data":"7c08de3194d7094c5479e1494998c1dc132586044f2e3c8eefde59c4c9880103"}
Jul 07 11:41:19.455865 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:19.455836    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfc7d" event={"ID":"f7270841-92d4-4c62-b476-17a56cbf4670","Type":"ContainerStarted","Data":"39e6486c0fda96f28e4819f1ee082f13783118e752f750b047eec688d89cbce8"}
Jul 07 11:41:19.455966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:19.455884    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfc7d" event={"ID":"f7270841-92d4-4c62-b476-17a56cbf4670","Type":"ContainerStarted","Data":"85ca8b5c05c0b5a9a8dc2d90b1d7931f027267d3244ed6ba490f24f5a9dfcf30"}
Jul 07 11:41:20.463423 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:20.463383    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bfc7d" event={"ID":"f7270841-92d4-4c62-b476-17a56cbf4670","Type":"ContainerStarted","Data":"935d786818bb06cf6f78de7865e32d6fd24c19e9ba000a131a1238405846d7f6"}
Jul 07 11:41:20.556392 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:20.556328    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bfc7d" podStartSLOduration=67.7178991 podStartE2EDuration="1m8.5563079s" totalImagesPullingTime="838.4088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:20.554960122 +0000 UTC m=+68.884910677" watchObservedRunningTime="2026-07-07 11:41:20.5563079 +0000 UTC m=+68.886258455"
Jul 07 11:41:21.618344 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.618312    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"]
Jul 07 11:41:21.642170 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.642142    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.662089 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.662063    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 11:41:21.662221 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.662063    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 11:41:21.662221 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.662072    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 11:41:21.663084 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.663060    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dzjj5\""
Jul 07 11:41:21.663204 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.663085    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 11:41:21.663204 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.663063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 11:41:21.670736 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.670712    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"]
Jul 07 11:41:21.773661 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.773632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.773848 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.773673    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.773848 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.773759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9s2d\" (UniqueName: \"kubernetes.io/projected/f3356462-ae5a-4ed3-818d-871a26d335f7-kube-api-access-n9s2d\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.773848 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.773799    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3356462-ae5a-4ed3-818d-871a26d335f7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.875063 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.874979    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.875063 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.875039    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9s2d\" (UniqueName: \"kubernetes.io/projected/f3356462-ae5a-4ed3-818d-871a26d335f7-kube-api-access-n9s2d\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.875283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.875067    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3356462-ae5a-4ed3-818d-871a26d335f7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.875283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.875108    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.875948 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.875917    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f3356462-ae5a-4ed3-818d-871a26d335f7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.877873 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.877846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.878011 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.877929    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3356462-ae5a-4ed3-818d-871a26d335f7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.981244 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.981214    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-56rq4"]
Jul 07 11:41:21.982543 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.982517    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9s2d\" (UniqueName: \"kubernetes.io/projected/f3356462-ae5a-4ed3-818d-871a26d335f7-kube-api-access-n9s2d\") pod \"openshift-state-metrics-54cf96dfcf-qjk8w\" (UID: \"f3356462-ae5a-4ed3-818d-871a26d335f7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:21.983644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:21.983613    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.006354 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.006326    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 11:41:22.006354 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.006346    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 11:41:22.006520 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.006385    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 11:41:22.076272 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztxw\" (UniqueName: \"kubernetes.io/projected/7b591266-515e-4f31-9fd5-de472f627373-kube-api-access-nztxw\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076340    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-wtmp\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-sys\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076393    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-accelerators-collector-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076610 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076435    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-tls\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076610 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076485    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-metrics-client-ca\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076610 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076550    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-root\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076610 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.076791 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.076628    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-textfile\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.142091 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.142028    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gktvm\""
Jul 07 11:41:22.177379 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177353    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-wtmp\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177384    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-sys\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177414    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-accelerators-collector-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-sys\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177520    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-tls\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177577    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-metrics-client-ca\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177584    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-wtmp\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177607    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-root\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177661    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b591266-515e-4f31-9fd5-de472f627373-root\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177695 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177691    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177986 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177721    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-textfile\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.177986 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.177765    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztxw\" (UniqueName: \"kubernetes.io/projected/7b591266-515e-4f31-9fd5-de472f627373-kube-api-access-nztxw\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.178146 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.178100    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-accelerators-collector-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.178256 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.178154    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-textfile\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.178256 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.178175    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b591266-515e-4f31-9fd5-de472f627373-metrics-client-ca\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.180658 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.180635    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.180835 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.180816    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b591266-515e-4f31-9fd5-de472f627373-node-exporter-tls\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.251967 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.251935    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"
Jul 07 11:41:22.300595 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.300572    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztxw\" (UniqueName: \"kubernetes.io/projected/7b591266-515e-4f31-9fd5-de472f627373-kube-api-access-nztxw\") pod \"node-exporter-56rq4\" (UID: \"7b591266-515e-4f31-9fd5-de472f627373\") " pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:22.597343 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:22.597310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-56rq4"
Jul 07 11:41:23.196896 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.196830    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:41:23.199943 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.199915    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.235169 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.235141    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 11:41:23.235487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.235468    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2vrwd\""
Jul 07 11:41:23.235487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.235477    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 11:41:23.235487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.235474    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 11:41:23.255045 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.254881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 11:41:23.255045 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.254965    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 11:41:23.255623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.255094    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 11:41:23.255623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.254881    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 11:41:23.255623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.255273    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 11:41:23.257527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:23.257468    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b591266_515e_4f31_9fd5_de472f627373.slice/crio-778143cca560f14461fa0b47006a15ecbf8a3996dbc5dcbad4d3d8fdc9adda7a WatchSource:0}: Error finding container 778143cca560f14461fa0b47006a15ecbf8a3996dbc5dcbad4d3d8fdc9adda7a: Status 404 returned error can't find the container with id 778143cca560f14461fa0b47006a15ecbf8a3996dbc5dcbad4d3d8fdc9adda7a
Jul 07 11:41:23.257939 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.257863    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:41:23.271384 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.271362    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 11:41:23.286243 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286252    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286269    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286288    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286313    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57mb4\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286399    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286418    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286432    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286466    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.286840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.286503    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387463 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387430    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57mb4\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387540    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387564    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387581    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387596    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387645    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387667    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387696    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387713    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387730    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.387981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.387743    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.388770 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.388742    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.389081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.389057    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.389797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.389747    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.390779 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.390732    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.390870 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.390843    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.390937 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.390843    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.390937 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.390888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.391030 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.390992    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.391483 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.391457    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.392194 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.392173    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.392437 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.392419    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.392834 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.392814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.400990 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.400970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57mb4\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4\") pod \"alertmanager-main-0\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.452454 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.452433    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w"]
Jul 07 11:41:23.454823 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:23.454799    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3356462_ae5a_4ed3_818d_871a26d335f7.slice/crio-565858a1da3ade399936ab3b1b8c79d75111e70fc9516ca5625f1419ce98e952 WatchSource:0}: Error finding container 565858a1da3ade399936ab3b1b8c79d75111e70fc9516ca5625f1419ce98e952: Status 404 returned error can't find the container with id 565858a1da3ade399936ab3b1b8c79d75111e70fc9516ca5625f1419ce98e952
Jul 07 11:41:23.476572 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.476523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w" event={"ID":"f3356462-ae5a-4ed3-818d-871a26d335f7","Type":"ContainerStarted","Data":"565858a1da3ade399936ab3b1b8c79d75111e70fc9516ca5625f1419ce98e952"}
Jul 07 11:41:23.477653 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.477628    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56rq4" event={"ID":"7b591266-515e-4f31-9fd5-de472f627373","Type":"ContainerStarted","Data":"778143cca560f14461fa0b47006a15ecbf8a3996dbc5dcbad4d3d8fdc9adda7a"}
Jul 07 11:41:23.478956 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.478931    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-267gf" event={"ID":"c8f39cb0-9ed5-407f-bc24-4d5a50629eb8","Type":"ContainerStarted","Data":"b7ce52aa4d577d863f769be35fc97559e86373807a7e3c16bf206bae2c3a7b57"}
Jul 07 11:41:23.480333 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.480309    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f2vwq" event={"ID":"e8447192-4f91-4dcb-be7d-00eb51811bcd","Type":"ContainerStarted","Data":"7a17b5ccdfbc5a5d2a7c88d61e0d4a55a4d28df8d9cee96d2817aad732299517"}
Jul 07 11:41:23.480439 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.480427    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:23.511427 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.511320    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:41:23.578247 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.578166    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-267gf" podStartSLOduration=66.60335157 podStartE2EDuration="1m11.578125631s" totalImagesPullingTime="4.974774061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:23.578067608 +0000 UTC m=+71.908018161" watchObservedRunningTime="2026-07-07 11:41:23.578125631 +0000 UTC m=+71.908076178"
Jul 07 11:41:23.665377 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.665330    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f2vwq" podStartSLOduration=66.898956991 podStartE2EDuration="1m11.665311333s" totalImagesPullingTime="4.766354342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:23.663874006 +0000 UTC m=+71.993824559" watchObservedRunningTime="2026-07-07 11:41:23.665311333 +0000 UTC m=+71.995261886"
Jul 07 11:41:23.692577 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:23.692551    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:41:23.695429 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:23.695409    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cd7bcee_43fc_4451_93c7_7d7afa4bc248.slice/crio-3f614679995196e00f49152ba05ef56b81652b951ec87015cb8141abeab44791 WatchSource:0}: Error finding container 3f614679995196e00f49152ba05ef56b81652b951ec87015cb8141abeab44791: Status 404 returned error can't find the container with id 3f614679995196e00f49152ba05ef56b81652b951ec87015cb8141abeab44791
Jul 07 11:41:24.436913 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:24.436882    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8b77h"
Jul 07 11:41:24.486378 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:24.486347    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w" event={"ID":"f3356462-ae5a-4ed3-818d-871a26d335f7","Type":"ContainerStarted","Data":"58eafd9aab45ffdc80462765f38cc86322a300d3fa247deeca4baf3af9737d2d"}
Jul 07 11:41:24.486514 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:24.486416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w" event={"ID":"f3356462-ae5a-4ed3-818d-871a26d335f7","Type":"ContainerStarted","Data":"4c33b2b45b9442586145aad210acd8e4cded32bb2b7fcd31bccbc842ceeb8f4c"}
Jul 07 11:41:24.487748 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:24.487721    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"3f614679995196e00f49152ba05ef56b81652b951ec87015cb8141abeab44791"}
Jul 07 11:41:25.495784 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.495748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w" event={"ID":"f3356462-ae5a-4ed3-818d-871a26d335f7","Type":"ContainerStarted","Data":"d422cdc57b35b60e317172eb50ad74d347868508639743531cb5e4ae0c0c4e89"}
Jul 07 11:41:25.497193 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.497163    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1" exitCode=0
Jul 07 11:41:25.497335 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.497257    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"}
Jul 07 11:41:25.498785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.498756    2573 generic.go:356] "Generic (PLEG): container finished" podID="7b591266-515e-4f31-9fd5-de472f627373" containerID="ca289819655766f30a9f96a504f12890f8827dab55df1ea86a8497e7a148e474" exitCode=0
Jul 07 11:41:25.498901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.498817    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56rq4" event={"ID":"7b591266-515e-4f31-9fd5-de472f627373","Type":"ContainerDied","Data":"ca289819655766f30a9f96a504f12890f8827dab55df1ea86a8497e7a148e474"}
Jul 07 11:41:25.536354 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:25.536295    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-qjk8w" podStartSLOduration=3.655014907 podStartE2EDuration="4.536275682s" totalImagesPullingTime="881.260775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:25.535746923 +0000 UTC m=+73.865697477" watchObservedRunningTime="2026-07-07 11:41:25.536275682 +0000 UTC m=+73.866226238"
Jul 07 11:41:26.504560 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:26.504523    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56rq4" event={"ID":"7b591266-515e-4f31-9fd5-de472f627373","Type":"ContainerStarted","Data":"9f460935a5c5058d3a7e900601b8963bcd4068bbff666942109c711a214fb182"}
Jul 07 11:41:26.504958 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:26.504586    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-56rq4" event={"ID":"7b591266-515e-4f31-9fd5-de472f627373","Type":"ContainerStarted","Data":"986e02d17cfafb4329acd0449591e45f3302e2b7c4d0d09fa9632a02ce9770ee"}
Jul 07 11:41:26.798969 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:26.798872    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-56rq4" podStartSLOduration=4.521596645 podStartE2EDuration="5.798850816s" totalImagesPullingTime="1.191119241s" totalInitContainerRuntime="86.13493ms" isStatefulPod=true podCreationTimestamp="2026-07-07 11:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:26.797098709 +0000 UTC m=+75.127049266" watchObservedRunningTime="2026-07-07 11:41:26.798850816 +0000 UTC m=+75.128801369"
Jul 07 11:41:27.333719 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.333695    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"]
Jul 07 11:41:27.335416 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.335398    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.349972 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.349925    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 11:41:27.350459 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.350344    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 11:41:27.351165 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.351148    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 11:41:27.351320 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.351303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dnumhaqnddk8\""
Jul 07 11:41:27.386947 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.386921    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 11:41:27.387102 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.387085    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5dcsp\""
Jul 07 11:41:27.388171 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.388152    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"]
Jul 07 11:41:27.421433 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-client-certs\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421561 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421445    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6r7n\" (UniqueName: \"kubernetes.io/projected/2ec3c53c-3007-4ae9-a9ee-084fb736f422-kube-api-access-h6r7n\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421561 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-metrics-server-audit-profiles\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421561 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-tls\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421561 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421546    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ec3c53c-3007-4ae9-a9ee-084fb736f422-audit-log\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421713 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421591    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.421713 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.421621    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-client-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.511758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.511731    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"}
Jul 07 11:41:27.512074 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.511788    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"}
Jul 07 11:41:27.512074 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.511827    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"}
Jul 07 11:41:27.512074 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.511871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"}
Jul 07 11:41:27.512074 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.511897    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"}
Jul 07 11:41:27.522528 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522504    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-client-certs\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522598 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522545    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6r7n\" (UniqueName: \"kubernetes.io/projected/2ec3c53c-3007-4ae9-a9ee-084fb736f422-kube-api-access-h6r7n\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522598 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522572    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-metrics-server-audit-profiles\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522598 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522590    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-tls\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522696 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522606    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ec3c53c-3007-4ae9-a9ee-084fb736f422-audit-log\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522696 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.522696 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.522662    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-client-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.523138 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.523118    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2ec3c53c-3007-4ae9-a9ee-084fb736f422-audit-log\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.523376 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.523352    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.523778 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.523756    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2ec3c53c-3007-4ae9-a9ee-084fb736f422-metrics-server-audit-profiles\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.525196 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.525169    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-client-ca-bundle\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.525196 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.525185    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-tls\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.525309 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.525227    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2ec3c53c-3007-4ae9-a9ee-084fb736f422-secret-metrics-server-client-certs\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.584046 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.584001    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6r7n\" (UniqueName: \"kubernetes.io/projected/2ec3c53c-3007-4ae9-a9ee-084fb736f422-kube-api-access-h6r7n\") pod \"metrics-server-5b8d89f6c9-gtcwj\" (UID: \"2ec3c53c-3007-4ae9-a9ee-084fb736f422\") " pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.646982 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.646961    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:27.853393 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:27.853321    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"]
Jul 07 11:41:27.856847 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:27.856823    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec3c53c_3007_4ae9_a9ee_084fb736f422.slice/crio-30d561390bcd4890fe463d1b650c4b7f74f7478749e155522cd28f0b930bc46a WatchSource:0}: Error finding container 30d561390bcd4890fe463d1b650c4b7f74f7478749e155522cd28f0b930bc46a: Status 404 returned error can't find the container with id 30d561390bcd4890fe463d1b650c4b7f74f7478749e155522cd28f0b930bc46a
Jul 07 11:41:28.520035 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:28.519999    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerStarted","Data":"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"}
Jul 07 11:41:28.521546 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:28.521517    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj" event={"ID":"2ec3c53c-3007-4ae9-a9ee-084fb736f422","Type":"ContainerStarted","Data":"30d561390bcd4890fe463d1b650c4b7f74f7478749e155522cd28f0b930bc46a"}
Jul 07 11:41:29.527411 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:29.527368    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj" event={"ID":"2ec3c53c-3007-4ae9-a9ee-084fb736f422","Type":"ContainerStarted","Data":"651eb224c27e71d9e6bae47fdefbd476fb7117534a75bd49550153854e265c19"}
Jul 07 11:41:29.632649 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:29.632599    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.150015587 podStartE2EDuration="6.632583787s" totalImagesPullingTime="3.465591987s" totalInitContainerRuntime="16.976213ms" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:28.618929093 +0000 UTC m=+76.948879648" watchObservedRunningTime="2026-07-07 11:41:29.632583787 +0000 UTC m=+77.962534366"
Jul 07 11:41:29.632798 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:29.632752    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj" podStartSLOduration=1.324802722 podStartE2EDuration="2.632746054s" totalImagesPullingTime="1.307943332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:29.631948935 +0000 UTC m=+77.961899487" watchObservedRunningTime="2026-07-07 11:41:29.632746054 +0000 UTC m=+77.962696607"
Jul 07 11:41:30.414080 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:30.414056    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fdf547d95-6t4wn"
Jul 07 11:41:32.010964 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.010932    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-rr8mk"]
Jul 07 11:41:32.013124 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.013105    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:32.016778 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.015683    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 11:41:32.016778 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.016344    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t9dr8\""
Jul 07 11:41:32.016778 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.016691    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 11:41:32.036579 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.036556    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rr8mk"]
Jul 07 11:41:32.164385 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.164346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjqqp\" (UniqueName: \"kubernetes.io/projected/19f6f7c2-351a-42a0-b30f-0e603ca7c7e7-kube-api-access-jjqqp\") pod \"downloads-685bfb5f64-rr8mk\" (UID: \"19f6f7c2-351a-42a0-b30f-0e603ca7c7e7\") " pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:32.264975 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.264900    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjqqp\" (UniqueName: \"kubernetes.io/projected/19f6f7c2-351a-42a0-b30f-0e603ca7c7e7-kube-api-access-jjqqp\") pod \"downloads-685bfb5f64-rr8mk\" (UID: \"19f6f7c2-351a-42a0-b30f-0e603ca7c7e7\") " pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:32.290533 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.290487    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjqqp\" (UniqueName: \"kubernetes.io/projected/19f6f7c2-351a-42a0-b30f-0e603ca7c7e7-kube-api-access-jjqqp\") pod \"downloads-685bfb5f64-rr8mk\" (UID: \"19f6f7c2-351a-42a0-b30f-0e603ca7c7e7\") " pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:32.322825 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.322801    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:32.472699 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.472654    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-rr8mk"]
Jul 07 11:41:32.479199 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:32.479169    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f6f7c2_351a_42a0_b30f_0e603ca7c7e7.slice/crio-df804a9fd48ad487025e52f31bb1a85ffc816631e725233f894fef10a76caf4e WatchSource:0}: Error finding container df804a9fd48ad487025e52f31bb1a85ffc816631e725233f894fef10a76caf4e: Status 404 returned error can't find the container with id df804a9fd48ad487025e52f31bb1a85ffc816631e725233f894fef10a76caf4e
Jul 07 11:41:32.539337 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:32.539255    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rr8mk" event={"ID":"19f6f7c2-351a-42a0-b30f-0e603ca7c7e7","Type":"ContainerStarted","Data":"df804a9fd48ad487025e52f31bb1a85ffc816631e725233f894fef10a76caf4e"}
Jul 07 11:41:40.665218 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.665182    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:41:40.668038 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.668017    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.670371 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.670303    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 11:41:40.670535 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.670449    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 11:41:40.671081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.671063    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rv6lb\""
Jul 07 11:41:40.672865 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.672798    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 11:41:40.672959 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.672879    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 11:41:40.674060 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.674039    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 11:41:40.687014 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.686990    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:41:40.836258 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836227    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn4sd\" (UniqueName: \"kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.836417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836266    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.836417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836307    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.836417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836341    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.836417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.836639 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.836428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937776    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937997 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937829    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937997 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937867    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn4sd\" (UniqueName: \"kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937997 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937890    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937997 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.937997 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.937965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.938625 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.938585    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.938882 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.938845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.938964 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.938913    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.940582 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.940558    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.940703 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.940684    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.946775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.946749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn4sd\" (UniqueName: \"kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd\") pod \"console-66f4fbd8c6-jmg4c\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") " pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:40.979662 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:40.979633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:41:45.534790 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.534754    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:41:45.691137 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.691101    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:41:45.691313 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.691222    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.702653 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.702631    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 11:41:45.780344 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780309    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780511 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780511 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780645 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780645 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q59h\" (UniqueName: \"kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780645 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.780645 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.780639    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881284 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881194    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q59h\" (UniqueName: \"kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881284 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881243    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881284 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881278    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881307    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881363    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881390    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.881623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.881556    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.882210 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.882173    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.882294 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.882225    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.882294 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.882233    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.882294 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.882242    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.884334 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.884306    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.884408 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.884379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:45.894291 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:45.894246    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q59h\" (UniqueName: \"kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h\") pod \"console-78489559c4-zw5qk\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") " pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:46.003608 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:46.003578    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:47.647351 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:47.647320    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:47.647810 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:47.647384    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:41:48.125693 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.125668    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:41:48.135327 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.135308    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:41:48.306877 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:48.306812    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bec484_5e54_4ce1_bded_b8232402b076.slice/crio-dfe9571ae17d62812f9850bef5cd18818375eef888843722699ab2213146955b WatchSource:0}: Error finding container dfe9571ae17d62812f9850bef5cd18818375eef888843722699ab2213146955b: Status 404 returned error can't find the container with id dfe9571ae17d62812f9850bef5cd18818375eef888843722699ab2213146955b
Jul 07 11:41:48.307672 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:41:48.307644    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1e12c6_9bbe_4760_b4ac_560c63beac0a.slice/crio-8c40cadaf123c61a439812959f9b52e40039ff530ff21346b654eeddafc5845c WatchSource:0}: Error finding container 8c40cadaf123c61a439812959f9b52e40039ff530ff21346b654eeddafc5845c: Status 404 returned error can't find the container with id 8c40cadaf123c61a439812959f9b52e40039ff530ff21346b654eeddafc5845c
Jul 07 11:41:48.607087 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.607009    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-rr8mk" event={"ID":"19f6f7c2-351a-42a0-b30f-0e603ca7c7e7","Type":"ContainerStarted","Data":"6c28178d3bfcd08367aaafb2f6a2f672f7a5633e69528abc4e737a109dcb0cc3"}
Jul 07 11:41:48.607232 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.607211    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:48.608908 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.608878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f4fbd8c6-jmg4c" event={"ID":"2c1e12c6-9bbe-4760-b4ac-560c63beac0a","Type":"ContainerStarted","Data":"8c40cadaf123c61a439812959f9b52e40039ff530ff21346b654eeddafc5845c"}
Jul 07 11:41:48.610213 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.610189    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78489559c4-zw5qk" event={"ID":"06bec484-5e54-4ce1-bded-b8232402b076","Type":"ContainerStarted","Data":"dfe9571ae17d62812f9850bef5cd18818375eef888843722699ab2213146955b"}
Jul 07 11:41:48.614836 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.614817    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-rr8mk"
Jul 07 11:41:48.671516 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:48.671440    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-rr8mk" podStartSLOduration=1.772824066 podStartE2EDuration="17.671420869s" totalImagesPullingTime="15.898596803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:48.635559004 +0000 UTC m=+96.965509558" watchObservedRunningTime="2026-07-07 11:41:48.671420869 +0000 UTC m=+97.001371423"
Jul 07 11:41:52.632203 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:52.632161    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f4fbd8c6-jmg4c" event={"ID":"2c1e12c6-9bbe-4760-b4ac-560c63beac0a","Type":"ContainerStarted","Data":"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"}
Jul 07 11:41:52.634097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:52.634070    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78489559c4-zw5qk" event={"ID":"06bec484-5e54-4ce1-bded-b8232402b076","Type":"ContainerStarted","Data":"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"}
Jul 07 11:41:52.665135 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:52.665080    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66f4fbd8c6-jmg4c" podStartSLOduration=8.637756364 podStartE2EDuration="12.66506566s" totalImagesPullingTime="4.027309296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:52.664967827 +0000 UTC m=+100.994918405" watchObservedRunningTime="2026-07-07 11:41:52.66506566 +0000 UTC m=+100.995016213"
Jul 07 11:41:52.695433 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:52.695386    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78489559c4-zw5qk" podStartSLOduration=3.6607460339999998 podStartE2EDuration="7.695367452s" totalImagesPullingTime="4.034621418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:41:52.694320314 +0000 UTC m=+101.024270866" watchObservedRunningTime="2026-07-07 11:41:52.695367452 +0000 UTC m=+101.025318006"
Jul 07 11:41:54.490290 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:54.490256    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f2vwq"
Jul 07 11:41:56.004208 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:56.004170    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:56.004674 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:56.004229    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:56.009923 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:56.009896    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:56.655939 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:56.655909    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:41:56.738979 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:41:56.738942    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:42:00.979769 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:00.979720    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:42:07.652779 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:07.652744    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:42:07.656705 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:07.656679    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b8d89f6c9-gtcwj"
Jul 07 11:42:21.764038 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:21.763977    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66f4fbd8c6-jmg4c" podUID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" containerName="console" containerID="cri-o://a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1" gracePeriod=15
Jul 07 11:42:22.068018 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.067657    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:42:22.171350 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171309    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.171583 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171365    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.171583 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171393    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.171583 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171437    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bn4sd\" (UniqueName: \"kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.171583 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171472    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.171836 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.171582    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config\") pod \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\" (UID: \"2c1e12c6-9bbe-4760-b4ac-560c63beac0a\") "
Jul 07 11:42:22.173582 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.173311    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:42:22.173890 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.173853    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config" (OuterVolumeSpecName: "console-config") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:42:22.173993 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.173926    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca" (OuterVolumeSpecName: "service-ca") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:42:22.174885 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.174855    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:22.175747 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.175720    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd" (OuterVolumeSpecName: "kube-api-access-bn4sd") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "kube-api-access-bn4sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:42:22.175930 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.175907    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2c1e12c6-9bbe-4760-b4ac-560c63beac0a" (UID: "2c1e12c6-9bbe-4760-b4ac-560c63beac0a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:22.272573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272542    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-oauth-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.272573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272570    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-service-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.272758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272583    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.272758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272593    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bn4sd\" (UniqueName: \"kubernetes.io/projected/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-kube-api-access-bn4sd\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.272758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272602    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.272758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.272633    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2c1e12c6-9bbe-4760-b4ac-560c63beac0a-console-oauth-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:22.748654 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.748622    2573 generic.go:356] "Generic (PLEG): container finished" podID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" containerID="a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1" exitCode=0
Jul 07 11:42:22.748850 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.748672    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66f4fbd8c6-jmg4c"
Jul 07 11:42:22.748850 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.748675    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f4fbd8c6-jmg4c" event={"ID":"2c1e12c6-9bbe-4760-b4ac-560c63beac0a","Type":"ContainerDied","Data":"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"}
Jul 07 11:42:22.748850 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.748780    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66f4fbd8c6-jmg4c" event={"ID":"2c1e12c6-9bbe-4760-b4ac-560c63beac0a","Type":"ContainerDied","Data":"8c40cadaf123c61a439812959f9b52e40039ff530ff21346b654eeddafc5845c"}
Jul 07 11:42:22.748850 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.748801    2573 scope.go:117] "RemoveContainer" containerID="a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"
Jul 07 11:42:22.765649 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.765474    2573 scope.go:117] "RemoveContainer" containerID="a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"
Jul 07 11:42:22.765950 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:22.765781    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1\": container with ID starting with a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1 not found: ID does not exist" containerID="a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"
Jul 07 11:42:22.765950 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.765817    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1"} err="failed to get container status \"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1\": rpc error: code = NotFound desc = could not find container \"a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1\": container with ID starting with a1e6bd5e74d7c1a14bc82261b13f97d8c789297cef4655f47e6d6fe3d416b2e1 not found: ID does not exist"
Jul 07 11:42:22.771195 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.771170    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:42:22.777353 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:22.777322    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66f4fbd8c6-jmg4c"]
Jul 07 11:42:24.172853 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:24.172820    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" path="/var/lib/kubelet/pods/2c1e12c6-9bbe-4760-b4ac-560c63beac0a/volumes"
Jul 07 11:42:43.387394 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387360    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:43.387922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387658    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="alertmanager" containerID="cri-o://d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75" gracePeriod=120
Jul 07 11:42:43.387922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387720    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-metric" containerID="cri-o://559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1" gracePeriod=120
Jul 07 11:42:43.387922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387779    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="prom-label-proxy" containerID="cri-o://d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3" gracePeriod=120
Jul 07 11:42:43.387922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387801    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="config-reloader" containerID="cri-o://393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715" gracePeriod=120
Jul 07 11:42:43.387922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387844    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy" containerID="cri-o://6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1" gracePeriod=120
Jul 07 11:42:43.388211 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.387988    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-web" containerID="cri-o://253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c" gracePeriod=120
Jul 07 11:42:43.829296 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829266    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3" exitCode=0
Jul 07 11:42:43.829296 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829290    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1" exitCode=0
Jul 07 11:42:43.829296 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829297    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715" exitCode=0
Jul 07 11:42:43.829296 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829302    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75" exitCode=0
Jul 07 11:42:43.829573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829334    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"}
Jul 07 11:42:43.829573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829400    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"}
Jul 07 11:42:43.829573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829427    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"}
Jul 07 11:42:43.829573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:43.829452    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"}
Jul 07 11:42:44.661028 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.661004    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:44.739042 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.738977    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739042 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739022    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739051    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739089    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739120    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739158    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739184    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739233    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739263    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739305    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739335    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57mb4\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739367    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739394    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out\") pod \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\" (UID: \"1cd7bcee-43fc-4451-93c7-7d7afa4bc248\") "
Jul 07 11:42:44.739823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739474    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:42:44.739823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.739640    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.740366 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.740010    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:42:44.740694 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.740668    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:42:44.742138 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.742094    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.742550 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.742524    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4" (OuterVolumeSpecName: "kube-api-access-57mb4") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "kube-api-access-57mb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:42:44.742648 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.742540    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.743256 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.743220    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out" (OuterVolumeSpecName: "config-out") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:42:44.743364 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.743294    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume" (OuterVolumeSpecName: "config-volume") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.743963 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.743927    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:42:44.744041 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.744019    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.745024 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.744997    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.746594 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.746570    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.753788 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.753769    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config" (OuterVolumeSpecName: "web-config") pod "1cd7bcee-43fc-4451-93c7-7d7afa4bc248" (UID: "1cd7bcee-43fc-4451-93c7-7d7afa4bc248"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:42:44.835803 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835777    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1" exitCode=0
Jul 07 11:42:44.835803 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835799    2573 generic.go:356] "Generic (PLEG): container finished" podID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerID="253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c" exitCode=0
Jul 07 11:42:44.835922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835854    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:44.835922 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835862    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"}
Jul 07 11:42:44.835989 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835928    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"}
Jul 07 11:42:44.835989 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835959    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1cd7bcee-43fc-4451-93c7-7d7afa4bc248","Type":"ContainerDied","Data":"3f614679995196e00f49152ba05ef56b81652b951ec87015cb8141abeab44791"}
Jul 07 11:42:44.836043 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.835995    2573 scope.go:117] "RemoveContainer" containerID="d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"
Jul 07 11:42:44.840421 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840402    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-out\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840423    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-web-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840437    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840452    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840467    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-metrics-client-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840480    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-config-volume\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840508    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840522    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-alertmanager-main-db\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840534 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840534    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-tls-assets\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840791 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840547    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-cluster-tls-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840791 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840559    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57mb4\" (UniqueName: \"kubernetes.io/projected/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-kube-api-access-57mb4\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.840791 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.840572    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1cd7bcee-43fc-4451-93c7-7d7afa4bc248-secret-alertmanager-main-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:42:44.843943 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.843886    2573 scope.go:117] "RemoveContainer" containerID="559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"
Jul 07 11:42:44.850412 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.850396    2573 scope.go:117] "RemoveContainer" containerID="6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"
Jul 07 11:42:44.856456 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.856438    2573 scope.go:117] "RemoveContainer" containerID="253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"
Jul 07 11:42:44.863620 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.862488    2573 scope.go:117] "RemoveContainer" containerID="393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"
Jul 07 11:42:44.873101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.873083    2573 scope.go:117] "RemoveContainer" containerID="d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"
Jul 07 11:42:44.879553 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.879537    2573 scope.go:117] "RemoveContainer" containerID="3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"
Jul 07 11:42:44.886276 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886246    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:44.886333 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886318    2573 scope.go:117] "RemoveContainer" containerID="d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"
Jul 07 11:42:44.886638 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.886621    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3\": container with ID starting with d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3 not found: ID does not exist" containerID="d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"
Jul 07 11:42:44.886682 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886645    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"} err="failed to get container status \"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3\": rpc error: code = NotFound desc = could not find container \"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3\": container with ID starting with d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3 not found: ID does not exist"
Jul 07 11:42:44.886682 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886661    2573 scope.go:117] "RemoveContainer" containerID="559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"
Jul 07 11:42:44.886892 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.886871    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1\": container with ID starting with 559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1 not found: ID does not exist" containerID="559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"
Jul 07 11:42:44.886953 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886902    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"} err="failed to get container status \"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1\": rpc error: code = NotFound desc = could not find container \"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1\": container with ID starting with 559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1 not found: ID does not exist"
Jul 07 11:42:44.886953 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.886924    2573 scope.go:117] "RemoveContainer" containerID="6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"
Jul 07 11:42:44.887156 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.887139    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1\": container with ID starting with 6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1 not found: ID does not exist" containerID="6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"
Jul 07 11:42:44.887192 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887160    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"} err="failed to get container status \"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1\": rpc error: code = NotFound desc = could not find container \"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1\": container with ID starting with 6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1 not found: ID does not exist"
Jul 07 11:42:44.887192 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887175    2573 scope.go:117] "RemoveContainer" containerID="253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"
Jul 07 11:42:44.887390 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.887374    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c\": container with ID starting with 253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c not found: ID does not exist" containerID="253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"
Jul 07 11:42:44.887451 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887396    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"} err="failed to get container status \"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c\": rpc error: code = NotFound desc = could not find container \"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c\": container with ID starting with 253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c not found: ID does not exist"
Jul 07 11:42:44.887451 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887416    2573 scope.go:117] "RemoveContainer" containerID="393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"
Jul 07 11:42:44.887660 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.887643    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715\": container with ID starting with 393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715 not found: ID does not exist" containerID="393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"
Jul 07 11:42:44.887703 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887664    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"} err="failed to get container status \"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715\": rpc error: code = NotFound desc = could not find container \"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715\": container with ID starting with 393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715 not found: ID does not exist"
Jul 07 11:42:44.887703 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887678    2573 scope.go:117] "RemoveContainer" containerID="d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"
Jul 07 11:42:44.887910 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.887894    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75\": container with ID starting with d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75 not found: ID does not exist" containerID="d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"
Jul 07 11:42:44.887974 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887916    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"} err="failed to get container status \"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75\": rpc error: code = NotFound desc = could not find container \"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75\": container with ID starting with d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75 not found: ID does not exist"
Jul 07 11:42:44.887974 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.887936    2573 scope.go:117] "RemoveContainer" containerID="3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"
Jul 07 11:42:44.888163 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:42:44.888149    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1\": container with ID starting with 3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1 not found: ID does not exist" containerID="3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"
Jul 07 11:42:44.888220 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888168    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"} err="failed to get container status \"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1\": rpc error: code = NotFound desc = could not find container \"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1\": container with ID starting with 3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1 not found: ID does not exist"
Jul 07 11:42:44.888220 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888185    2573 scope.go:117] "RemoveContainer" containerID="d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"
Jul 07 11:42:44.888383 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888367    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3"} err="failed to get container status \"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3\": rpc error: code = NotFound desc = could not find container \"d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3\": container with ID starting with d81c2c4c14305d233bb23355247286c4e2304061fdaa669163fdf5032889d3f3 not found: ID does not exist"
Jul 07 11:42:44.888447 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888384    2573 scope.go:117] "RemoveContainer" containerID="559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"
Jul 07 11:42:44.888600 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888583    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1"} err="failed to get container status \"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1\": rpc error: code = NotFound desc = could not find container \"559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1\": container with ID starting with 559d42c3c24821127cc0a3e2495f1aedbd7c572248e89d507a9aa1f64d7a43d1 not found: ID does not exist"
Jul 07 11:42:44.888668 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888601    2573 scope.go:117] "RemoveContainer" containerID="6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"
Jul 07 11:42:44.888785 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888768    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1"} err="failed to get container status \"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1\": rpc error: code = NotFound desc = could not find container \"6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1\": container with ID starting with 6b07e532f3101c90a16123142052f32396f3f15ee64715fe59a2f43264a37bf1 not found: ID does not exist"
Jul 07 11:42:44.888851 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888786    2573 scope.go:117] "RemoveContainer" containerID="253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"
Jul 07 11:42:44.888989 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888973    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c"} err="failed to get container status \"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c\": rpc error: code = NotFound desc = could not find container \"253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c\": container with ID starting with 253c5224a7ef41b675ee323cac89c193641b9a7017795061645eeeb8063f590c not found: ID does not exist"
Jul 07 11:42:44.889052 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.888990    2573 scope.go:117] "RemoveContainer" containerID="393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"
Jul 07 11:42:44.889186 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.889171    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715"} err="failed to get container status \"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715\": rpc error: code = NotFound desc = could not find container \"393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715\": container with ID starting with 393377569fd07806dc0317c759f240cd3adf2741ec1b5e212ec9ba5d702be715 not found: ID does not exist"
Jul 07 11:42:44.889245 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.889187    2573 scope.go:117] "RemoveContainer" containerID="d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"
Jul 07 11:42:44.889373 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.889357    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75"} err="failed to get container status \"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75\": rpc error: code = NotFound desc = could not find container \"d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75\": container with ID starting with d2814aa32195b00dce7ee6616d3201163fb398766df25185fb2032ec1304ee75 not found: ID does not exist"
Jul 07 11:42:44.889438 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.889374    2573 scope.go:117] "RemoveContainer" containerID="3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"
Jul 07 11:42:44.889622 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.889604    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1"} err="failed to get container status \"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1\": rpc error: code = NotFound desc = could not find container \"3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1\": container with ID starting with 3e8b17e2dccbcc5915d36049f7fc90ae8a9b3b301b1782e6a42b67ce6ea971a1 not found: ID does not exist"
Jul 07 11:42:44.893565 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.893529    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:44.979835 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.979810    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:44.980081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980068    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-web"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980083    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-web"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980091    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-metric"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980097    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-metric"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980102    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="prom-label-proxy"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980108    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="prom-label-proxy"
Jul 07 11:42:44.980122 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980116    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="config-reloader"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980124    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="config-reloader"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980137    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980143    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980152    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="init-config-reloader"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980157    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="init-config-reloader"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980164    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="alertmanager"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980169    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="alertmanager"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980175    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" containerName="console"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980180    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" containerName="console"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980227    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-web"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980235    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy-metric"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980241    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="alertmanager"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980246    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="kube-rbac-proxy"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980251    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="prom-label-proxy"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980255    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1e12c6-9bbe-4760-b4ac-560c63beac0a" containerName="console"
Jul 07 11:42:44.980283 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.980261    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" containerName="config-reloader"
Jul 07 11:42:44.983340 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.983325    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:44.992926 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.992907    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 11:42:44.993011 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.992938    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 11:42:44.993190 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.993176    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2vrwd\""
Jul 07 11:42:44.993226 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.993212    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 11:42:44.993430 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.993418    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 11:42:44.994419 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.994403    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 11:42:44.994465 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.994403    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 11:42:44.994969 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.994952    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 11:42:44.997581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.997563    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 11:42:44.999815 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:44.999797    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 11:42:45.040163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.040139    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:45.142608 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142764 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142764 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142764 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142718    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-web-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142764 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142737    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142764 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hv89\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-kube-api-access-4hv89\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142798    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142862    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142881    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142913    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.142955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142944    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-out\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.143146 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.142963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243436    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243469    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243530 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243510    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243624    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243658    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-out\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243681    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243714    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.243775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243746    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243791    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243824    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-web-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243850    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243879    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hv89\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-kube-api-access-4hv89\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.243908    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244456 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.244418    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.244593 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.244484    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.245529 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.244982    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246673 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246628    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246791 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246762    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246766    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246895 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-out\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246936    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.246966 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.246958    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.247136 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.247117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-web-config\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.248014 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.247994    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ab96511-7a6d-48b4-9d53-6c0cbb276138-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.248255 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.248238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.254797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.254779    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hv89\" (UniqueName: \"kubernetes.io/projected/4ab96511-7a6d-48b4-9d53-6c0cbb276138-kube-api-access-4hv89\") pod \"alertmanager-main-0\" (UID: \"4ab96511-7a6d-48b4-9d53-6c0cbb276138\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.291891 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.291875    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 11:42:45.436406 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.436380    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 11:42:45.437416 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:42:45.437394    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab96511_7a6d_48b4_9d53_6c0cbb276138.slice/crio-d2d3f0742c0edae68e25590818da449c7ee736bd01836433b6cabe2fdfc3674e WatchSource:0}: Error finding container d2d3f0742c0edae68e25590818da449c7ee736bd01836433b6cabe2fdfc3674e: Status 404 returned error can't find the container with id d2d3f0742c0edae68e25590818da449c7ee736bd01836433b6cabe2fdfc3674e
Jul 07 11:42:45.842004 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.841921    2573 generic.go:356] "Generic (PLEG): container finished" podID="4ab96511-7a6d-48b4-9d53-6c0cbb276138" containerID="2559c0b86974d3c396f8b72861c21f64e8f45d697ae381e1e6ea5e2b5828c9c2" exitCode=0
Jul 07 11:42:45.842004 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.841973    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerDied","Data":"2559c0b86974d3c396f8b72861c21f64e8f45d697ae381e1e6ea5e2b5828c9c2"}
Jul 07 11:42:45.842386 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:45.842022    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"d2d3f0742c0edae68e25590818da449c7ee736bd01836433b6cabe2fdfc3674e"}
Jul 07 11:42:46.173087 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.173058    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cd7bcee-43fc-4451-93c7-7d7afa4bc248" path="/var/lib/kubelet/pods/1cd7bcee-43fc-4451-93c7-7d7afa4bc248/volumes"
Jul 07 11:42:46.848956 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.848923    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"ff6df9fd5508820a7662b2bf08617b9cbe4416c49fc84ab6ce330ffa583691ed"}
Jul 07 11:42:46.849346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.848988    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"8b9652b09544add9b71e19edfc8ac3883f3320ae3b0c983bcaa621bc2d9c9684"}
Jul 07 11:42:46.849346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.849016    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"8c8246c70d51720307091c80e9729898b22afe8d4938d8564e07f50ce1cd7230"}
Jul 07 11:42:46.849346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.849040    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"2254457985bc230e98a91ccb406b6f00a1412111cc0a5f9a32c4d43c3d8b459d"}
Jul 07 11:42:46.849346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.849062    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"02f59bd7bc691389dea331c2f246f8bd42f7ff71dac26b9e2640a0cfc0e876a9"}
Jul 07 11:42:46.849346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.849085    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ab96511-7a6d-48b4-9d53-6c0cbb276138","Type":"ContainerStarted","Data":"1c35cadd01e29c3de53a35b3b64084686f5231bdcec42a645c2dd0086865ed21"}
Jul 07 11:42:46.877400 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:46.877361    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.86047808 podStartE2EDuration="2.877344409s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.866329ms" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:46.875401389 +0000 UTC m=+155.205351943" watchObservedRunningTime="2026-07-07 11:42:46.877344409 +0000 UTC m=+155.207294982"
Jul 07 11:42:47.435940 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.435907    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-564fdf9475-d9wmp"]
Jul 07 11:42:47.438472 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.438458    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.442380 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 11:42:47.442518 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442444    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2v2bq\""
Jul 07 11:42:47.442518 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442507    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 11:42:47.442631 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442566    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 11:42:47.442631 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442595    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 11:42:47.442847 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.442834    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 11:42:47.451266 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.451250    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 11:42:47.458585 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.458564    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564fdf9475-d9wmp"]
Jul 07 11:42:47.567555 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567520    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-metrics-client-ca\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-serving-certs-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567636    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-federate-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567677 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567858 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567687    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.567858 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.567708    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtl2x\" (UniqueName: \"kubernetes.io/projected/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-kube-api-access-vtl2x\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668611 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668611 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668614    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668760 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668664    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtl2x\" (UniqueName: \"kubernetes.io/projected/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-kube-api-access-vtl2x\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668760 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668690    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-metrics-client-ca\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668760 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668728    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668855 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668760    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-serving-certs-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668855 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668785    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.668855 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.668812    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-federate-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.669540 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.669485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-serving-certs-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.669540 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.669522    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-metrics-client-ca\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.669703 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.669568    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.671251 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.671230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-federate-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.671346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.671282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.671556 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.671540    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.671743 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.671723    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-telemeter-client-tls\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.676797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.676779    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtl2x\" (UniqueName: \"kubernetes.io/projected/5c7cb524-cdbb-4e68-b8c8-b0d774a109d1-kube-api-access-vtl2x\") pod \"telemeter-client-564fdf9475-d9wmp\" (UID: \"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1\") " pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.747822 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.747772    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp"
Jul 07 11:42:47.872901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:47.872881    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-564fdf9475-d9wmp"]
Jul 07 11:42:47.874944 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:42:47.874911    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7cb524_cdbb_4e68_b8c8_b0d774a109d1.slice/crio-12946c3d53d5a0b63375307dab33b92ad6f6a9bb851491bb01efecd308c6982e WatchSource:0}: Error finding container 12946c3d53d5a0b63375307dab33b92ad6f6a9bb851491bb01efecd308c6982e: Status 404 returned error can't find the container with id 12946c3d53d5a0b63375307dab33b92ad6f6a9bb851491bb01efecd308c6982e
Jul 07 11:42:48.860954 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:48.860913    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp" event={"ID":"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1","Type":"ContainerStarted","Data":"12946c3d53d5a0b63375307dab33b92ad6f6a9bb851491bb01efecd308c6982e"}
Jul 07 11:42:49.868831 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:49.868797    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp" event={"ID":"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1","Type":"ContainerStarted","Data":"77c6406ef0fb27576c1a0dce12ded7260e83279d09b48e6db429f5d81f8ad2f7"}
Jul 07 11:42:49.869205 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:49.868852    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp" event={"ID":"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1","Type":"ContainerStarted","Data":"d7a8879705822d89bcae2de120e7d587fcbfc0446634751cc66dbd2a10045b62"}
Jul 07 11:42:49.869205 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:49.868872    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp" event={"ID":"5c7cb524-cdbb-4e68-b8c8-b0d774a109d1","Type":"ContainerStarted","Data":"3b6c91eee748eeccee49717acedbdba6e942b124aad7af5afb562f8a68c8c5d1"}
Jul 07 11:42:49.894073 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:49.894028    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-564fdf9475-d9wmp" podStartSLOduration=1.434736277 podStartE2EDuration="2.894012154s" totalImagesPullingTime="1.459275877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:49.892363654 +0000 UTC m=+158.222314208" watchObservedRunningTime="2026-07-07 11:42:49.894012154 +0000 UTC m=+158.223962744"
Jul 07 11:42:50.601430 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.601401    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:42:50.603233 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.603216    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.618270 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.618249    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:42:50.690979 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.690946    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcrq6\" (UniqueName: \"kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691100 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.690995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691100 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.691077    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.691111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.691145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.691160    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.691185 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.691177    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.791857 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791832    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.791941 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791862    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.791941 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791880    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.791941 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791915    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcrq6\" (UniqueName: \"kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792048 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791959    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792048 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.791999    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792048 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.792021    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792717 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.792691    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792835 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.792691    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792835 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.792795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.792953 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.792875    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.794441 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.794417    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.794540 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.794515    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.800041 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.800018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcrq6\" (UniqueName: \"kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6\") pod \"console-7c469c9694-tlk85\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") " pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:50.911483 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:50.911429    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:42:51.039038 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:51.039016    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:42:51.041421 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:42:51.041392    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9e74ca_2b15_48ee_a0ca_1443992725e3.slice/crio-eab739c04487e047e37d4b6ffd8bec3e3ee10fd42571672bd7b3c90fc08c237b WatchSource:0}: Error finding container eab739c04487e047e37d4b6ffd8bec3e3ee10fd42571672bd7b3c90fc08c237b: Status 404 returned error can't find the container with id eab739c04487e047e37d4b6ffd8bec3e3ee10fd42571672bd7b3c90fc08c237b
Jul 07 11:42:51.877311 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:51.877275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c469c9694-tlk85" event={"ID":"2f9e74ca-2b15-48ee-a0ca-1443992725e3","Type":"ContainerStarted","Data":"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"}
Jul 07 11:42:51.877489 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:51.877331    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c469c9694-tlk85" event={"ID":"2f9e74ca-2b15-48ee-a0ca-1443992725e3","Type":"ContainerStarted","Data":"eab739c04487e047e37d4b6ffd8bec3e3ee10fd42571672bd7b3c90fc08c237b"}
Jul 07 11:42:51.898775 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:42:51.898725    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c469c9694-tlk85" podStartSLOduration=1.8987101960000001 podStartE2EDuration="1.898710196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:42:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:42:51.898098641 +0000 UTC m=+160.228049211" watchObservedRunningTime="2026-07-07 11:42:51.898710196 +0000 UTC m=+160.228660786"
Jul 07 11:43:00.912111 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:00.912078    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:43:00.912548 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:00.912131    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:43:00.916963 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:00.916943    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:43:01.917419 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:01.917394    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:43:01.966376 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:01.966341    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:43:26.986375 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:26.986314    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78489559c4-zw5qk" podUID="06bec484-5e54-4ce1-bded-b8232402b076" containerName="console" containerID="cri-o://f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33" gracePeriod=15
Jul 07 11:43:27.229894 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.229868    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:43:27.364893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.364823    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.364893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.364858    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.364897    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.364938    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.364967    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7q59h\" (UniqueName: \"kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365003    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365026    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle\") pod \"06bec484-5e54-4ce1-bded-b8232402b076\" (UID: \"06bec484-5e54-4ce1-bded-b8232402b076\") "
Jul 07 11:43:27.365337 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365308    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:43:27.365396 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365333    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca" (OuterVolumeSpecName: "service-ca") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:43:27.365396 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365315    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config" (OuterVolumeSpecName: "console-config") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:43:27.365613 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.365587    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:43:27.367002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.366975    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:43:27.367002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.366990    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h" (OuterVolumeSpecName: "kube-api-access-7q59h") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "kube-api-access-7q59h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:43:27.367147 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.367132    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06bec484-5e54-4ce1-bded-b8232402b076" (UID: "06bec484-5e54-4ce1-bded-b8232402b076"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:43:27.465968 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.465944    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-service-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.465968 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.465966    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7q59h\" (UniqueName: \"kubernetes.io/projected/06bec484-5e54-4ce1-bded-b8232402b076-kube-api-access-7q59h\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.466097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.465976    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-oauth-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.466097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.465985    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.466097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.465994    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-console-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.466097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.466002    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06bec484-5e54-4ce1-bded-b8232402b076-console-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:27.466097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:27.466010    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06bec484-5e54-4ce1-bded-b8232402b076-oauth-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:43:28.005306 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.005271    2573 generic.go:356] "Generic (PLEG): container finished" podID="06bec484-5e54-4ce1-bded-b8232402b076" containerID="f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33" exitCode=0
Jul 07 11:43:28.005306 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.005306    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78489559c4-zw5qk" event={"ID":"06bec484-5e54-4ce1-bded-b8232402b076","Type":"ContainerDied","Data":"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"}
Jul 07 11:43:28.005780 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.005319    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78489559c4-zw5qk"
Jul 07 11:43:28.005780 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.005343    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78489559c4-zw5qk" event={"ID":"06bec484-5e54-4ce1-bded-b8232402b076","Type":"ContainerDied","Data":"dfe9571ae17d62812f9850bef5cd18818375eef888843722699ab2213146955b"}
Jul 07 11:43:28.005780 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.005364    2573 scope.go:117] "RemoveContainer" containerID="f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"
Jul 07 11:43:28.013788 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.013771    2573 scope.go:117] "RemoveContainer" containerID="f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"
Jul 07 11:43:28.014026 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:43:28.014010    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33\": container with ID starting with f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33 not found: ID does not exist" containerID="f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"
Jul 07 11:43:28.014070 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.014032    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33"} err="failed to get container status \"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33\": rpc error: code = NotFound desc = could not find container \"f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33\": container with ID starting with f74053ee30137703d49c29ae8d2c87b7ae52743bde4fa36ee61b28c70cfa0e33 not found: ID does not exist"
Jul 07 11:43:28.026101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.026077    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:43:28.029603 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.029584    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78489559c4-zw5qk"]
Jul 07 11:43:28.172090 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:43:28.172064    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06bec484-5e54-4ce1-bded-b8232402b076" path="/var/lib/kubelet/pods/06bec484-5e54-4ce1-bded-b8232402b076/volumes"
Jul 07 11:44:01.669257 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.669215    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:44:01.669876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.669649    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06bec484-5e54-4ce1-bded-b8232402b076" containerName="console"
Jul 07 11:44:01.669876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.669668    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="06bec484-5e54-4ce1-bded-b8232402b076" containerName="console"
Jul 07 11:44:01.669876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.669736    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="06bec484-5e54-4ce1-bded-b8232402b076" containerName="console"
Jul 07 11:44:01.671697 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.671676    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.686859 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.686840    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:44:01.810085 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810262 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810092    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810262 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810262 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810145    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810262 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810446 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810271    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.810446 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.810306    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgb92\" (UniqueName: \"kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911376 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911346    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911478 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911405    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911478 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911431    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911478 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911473    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911654 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911522    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911654 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911557    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgb92\" (UniqueName: \"kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.911654 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.911616    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.912229 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.912205    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.912387 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.912252    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.912387 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.912259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.912570 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.912552    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.914168 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.914148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.914243 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.914224    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.919982 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.919933    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgb92\" (UniqueName: \"kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92\") pod \"console-7bffb4758c-nskkb\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") " pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:01.980068 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:01.980041    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:02.107952 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:02.107926    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:44:02.110452 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:44:02.110428    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e51f09d_431d_4b72_aa75_1ef55430e9b0.slice/crio-495df5c990b24e75e3c3081db50700ee9a68605f61770e94b1a90147c6426635 WatchSource:0}: Error finding container 495df5c990b24e75e3c3081db50700ee9a68605f61770e94b1a90147c6426635: Status 404 returned error can't find the container with id 495df5c990b24e75e3c3081db50700ee9a68605f61770e94b1a90147c6426635
Jul 07 11:44:02.135074 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:02.135047    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bffb4758c-nskkb" event={"ID":"8e51f09d-431d-4b72-aa75-1ef55430e9b0","Type":"ContainerStarted","Data":"495df5c990b24e75e3c3081db50700ee9a68605f61770e94b1a90147c6426635"}
Jul 07 11:44:03.139993 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:03.139956    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bffb4758c-nskkb" event={"ID":"8e51f09d-431d-4b72-aa75-1ef55430e9b0","Type":"ContainerStarted","Data":"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"}
Jul 07 11:44:03.157309 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:03.157262    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bffb4758c-nskkb" podStartSLOduration=2.157250064 podStartE2EDuration="2.157250064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:44:03.15520241 +0000 UTC m=+231.485152956" watchObservedRunningTime="2026-07-07 11:44:03.157250064 +0000 UTC m=+231.487200617"
Jul 07 11:44:11.981116 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:11.981067    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:11.981599 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:11.981136    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:11.985709 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:11.985687    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:12.176152 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:12.176126    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:44:12.221826 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:12.221791    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:44:37.241302 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.241215    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c469c9694-tlk85" podUID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" containerName="console" containerID="cri-o://b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff" gracePeriod=15
Jul 07 11:44:37.470882 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.470859    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:44:37.559901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.559835    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.559901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.559867    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.559901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.559891    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.560086 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.559914    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcrq6\" (UniqueName: \"kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.560086 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.559976    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.560086 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560001    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.560086 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560045    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config\") pod \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\" (UID: \"2f9e74ca-2b15-48ee-a0ca-1443992725e3\") "
Jul 07 11:44:37.560302 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560282    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:44:37.560566 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560538    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:44:37.560566 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560552    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config" (OuterVolumeSpecName: "console-config") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:44:37.560759 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.560535    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:44:37.562016 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.561990    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:44:37.562111 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.562040    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6" (OuterVolumeSpecName: "kube-api-access-wcrq6") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "kube-api-access-wcrq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:44:37.562111 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.562043    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f9e74ca-2b15-48ee-a0ca-1443992725e3" (UID: "2f9e74ca-2b15-48ee-a0ca-1443992725e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:44:37.660800 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660777    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-oauth-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660800 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660796    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-oauth-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660931 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660805    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-service-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660931 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660814    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcrq6\" (UniqueName: \"kubernetes.io/projected/2f9e74ca-2b15-48ee-a0ca-1443992725e3-kube-api-access-wcrq6\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660931 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660822    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660931 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660831    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:37.660931 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:37.660839    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f9e74ca-2b15-48ee-a0ca-1443992725e3-console-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:44:38.262312 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.262282    2573 generic.go:356] "Generic (PLEG): container finished" podID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" containerID="b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff" exitCode=0
Jul 07 11:44:38.262738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.262324    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c469c9694-tlk85"
Jul 07 11:44:38.262738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.262326    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c469c9694-tlk85" event={"ID":"2f9e74ca-2b15-48ee-a0ca-1443992725e3","Type":"ContainerDied","Data":"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"}
Jul 07 11:44:38.262738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.262375    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c469c9694-tlk85" event={"ID":"2f9e74ca-2b15-48ee-a0ca-1443992725e3","Type":"ContainerDied","Data":"eab739c04487e047e37d4b6ffd8bec3e3ee10fd42571672bd7b3c90fc08c237b"}
Jul 07 11:44:38.262738 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.262405    2573 scope.go:117] "RemoveContainer" containerID="b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"
Jul 07 11:44:38.270278 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.270263    2573 scope.go:117] "RemoveContainer" containerID="b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"
Jul 07 11:44:38.270539 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:44:38.270520    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff\": container with ID starting with b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff not found: ID does not exist" containerID="b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"
Jul 07 11:44:38.270590 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.270547    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff"} err="failed to get container status \"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff\": rpc error: code = NotFound desc = could not find container \"b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff\": container with ID starting with b61c033d548ebfd8d5a8402922ee7c6575ba2cf4f819dcc1a4d1cff6dc4350ff not found: ID does not exist"
Jul 07 11:44:38.282397 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.282377    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:44:38.289234 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:38.289217    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c469c9694-tlk85"]
Jul 07 11:44:40.172546 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:44:40.172516    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" path="/var/lib/kubelet/pods/2f9e74ca-2b15-48ee-a0ca-1443992725e3/volumes"
Jul 07 11:45:12.052311 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:12.052283    2573 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 11:45:31.776170 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.776139    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"]
Jul 07 11:45:31.777522 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.776416    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" containerName="console"
Jul 07 11:45:31.777522 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.776426    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" containerName="console"
Jul 07 11:45:31.777522 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.776485    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f9e74ca-2b15-48ee-a0ca-1443992725e3" containerName="console"
Jul 07 11:45:31.778325 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.778310    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:31.780871 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.780849    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 11:45:31.780974 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.780955    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 11:45:31.781722 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.781706    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-wdj5l\""
Jul 07 11:45:31.792955 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.792933    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"]
Jul 07 11:45:31.954221 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.954186    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzxt7\" (UniqueName: \"kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:31.954388 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.954228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:31.954388 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:31.954305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.054965 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.054881    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzxt7\" (UniqueName: \"kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.054965 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.054922    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.055140 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.055041    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.055232 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.055222    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.055349 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.055334    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.065080 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.065058    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzxt7\" (UniqueName: \"kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.087021 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.087002    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:32.218377 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.218337    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"]
Jul 07 11:45:32.221268 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:45:32.221244    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e912048_b110_4918_9de2_bc01e91d8896.slice/crio-9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091 WatchSource:0}: Error finding container 9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091: Status 404 returned error can't find the container with id 9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091
Jul 07 11:45:32.223579 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.223565    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:45:32.457968 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:32.457936    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerStarted","Data":"9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091"}
Jul 07 11:45:38.483507 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:38.483462    2573 generic.go:356] "Generic (PLEG): container finished" podID="0e912048-b110-4918-9de2-bc01e91d8896" containerID="da52e21f57c9d3719af82e6db44524f1d5d90c20cb60aa9e92bdf4e2fbecf72e" exitCode=0
Jul 07 11:45:38.483981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:38.483524    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerDied","Data":"da52e21f57c9d3719af82e6db44524f1d5d90c20cb60aa9e92bdf4e2fbecf72e"}
Jul 07 11:45:41.496968 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:41.496894    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerStarted","Data":"292709f0608182bc5bac247b0c5ad57f2fb831d577797f916927c48a82a7b4b5"}
Jul 07 11:45:42.502200 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:42.502169    2573 generic.go:356] "Generic (PLEG): container finished" podID="0e912048-b110-4918-9de2-bc01e91d8896" containerID="292709f0608182bc5bac247b0c5ad57f2fb831d577797f916927c48a82a7b4b5" exitCode=0
Jul 07 11:45:42.502608 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:42.502256    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerDied","Data":"292709f0608182bc5bac247b0c5ad57f2fb831d577797f916927c48a82a7b4b5"}
Jul 07 11:45:49.532246 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:49.532207    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerStarted","Data":"d8e67acf1677e780c77de55a5aadd7f5b94e1e7ad201d5daa8f8f195e744d997"}
Jul 07 11:45:49.550050 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:49.550005    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" podStartSLOduration=2.782620322 podStartE2EDuration="18.549990881s" totalImagesPullingTime="15.767370559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:45:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:45:49.548388099 +0000 UTC m=+337.878338652" watchObservedRunningTime="2026-07-07 11:45:49.549990881 +0000 UTC m=+337.879941433"
Jul 07 11:45:50.538699 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:50.538670    2573 generic.go:356] "Generic (PLEG): container finished" podID="0e912048-b110-4918-9de2-bc01e91d8896" containerID="d8e67acf1677e780c77de55a5aadd7f5b94e1e7ad201d5daa8f8f195e744d997" exitCode=0
Jul 07 11:45:50.539113 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:50.538708    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerDied","Data":"d8e67acf1677e780c77de55a5aadd7f5b94e1e7ad201d5daa8f8f195e744d997"}
Jul 07 11:45:51.661161 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.661134    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:51.708701 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.708674    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util\") pod \"0e912048-b110-4918-9de2-bc01e91d8896\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") "
Jul 07 11:45:51.708809 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.708724    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzxt7\" (UniqueName: \"kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7\") pod \"0e912048-b110-4918-9de2-bc01e91d8896\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") "
Jul 07 11:45:51.708809 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.708748    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle\") pod \"0e912048-b110-4918-9de2-bc01e91d8896\" (UID: \"0e912048-b110-4918-9de2-bc01e91d8896\") "
Jul 07 11:45:51.709475 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.709441    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle" (OuterVolumeSpecName: "bundle") pod "0e912048-b110-4918-9de2-bc01e91d8896" (UID: "0e912048-b110-4918-9de2-bc01e91d8896"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:45:51.710663 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.710641    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7" (OuterVolumeSpecName: "kube-api-access-vzxt7") pod "0e912048-b110-4918-9de2-bc01e91d8896" (UID: "0e912048-b110-4918-9de2-bc01e91d8896"). InnerVolumeSpecName "kube-api-access-vzxt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:45:51.713811 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.713787    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util" (OuterVolumeSpecName: "util") pod "0e912048-b110-4918-9de2-bc01e91d8896" (UID: "0e912048-b110-4918-9de2-bc01e91d8896"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 11:45:51.810195 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.810145    2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-util\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:45:51.810195 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.810164    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzxt7\" (UniqueName: \"kubernetes.io/projected/0e912048-b110-4918-9de2-bc01e91d8896-kube-api-access-vzxt7\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:45:51.810195 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:51.810173    2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e912048-b110-4918-9de2-bc01e91d8896-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:45:52.546903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:52.546873    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds" event={"ID":"0e912048-b110-4918-9de2-bc01e91d8896","Type":"ContainerDied","Data":"9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091"}
Jul 07 11:45:52.547060 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:52.546917    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589l9sds"
Jul 07 11:45:52.547060 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:52.546919    2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a0a9ac5b433438f4e95463b54411c6c8810a7286a7fb7f560b4f5eed77b2091"
Jul 07 11:45:59.728659 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728625    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"]
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728910    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="pull"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728921    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="pull"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728932    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="util"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728937    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="util"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728947    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="extract"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="extract"
Jul 07 11:45:59.729093 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.728996    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e912048-b110-4918-9de2-bc01e91d8896" containerName="extract"
Jul 07 11:45:59.735035 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.735000    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.737549 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.737531    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-m9z7w\""
Jul 07 11:45:59.737900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.737887    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 07 11:45:59.738281 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.738266    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 07 11:45:59.738331 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.738265    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 07 11:45:59.749089 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.749070    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"]
Jul 07 11:45:59.765347 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.765327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7034d671-5d18-41b6-bc4e-3ad1290abc3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.765424 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.765376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5pb\" (UniqueName: \"kubernetes.io/projected/7034d671-5d18-41b6-bc4e-3ad1290abc3d-kube-api-access-mb5pb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.866346 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.866315    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7034d671-5d18-41b6-bc4e-3ad1290abc3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.866442 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.866373    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5pb\" (UniqueName: \"kubernetes.io/projected/7034d671-5d18-41b6-bc4e-3ad1290abc3d-kube-api-access-mb5pb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.868551 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.868533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/7034d671-5d18-41b6-bc4e-3ad1290abc3d-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:45:59.875468 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:45:59.875448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5pb\" (UniqueName: \"kubernetes.io/projected/7034d671-5d18-41b6-bc4e-3ad1290abc3d-kube-api-access-mb5pb\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj\" (UID: \"7034d671-5d18-41b6-bc4e-3ad1290abc3d\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:46:00.044578 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:00.044524    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:46:00.175005 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:00.174983    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"]
Jul 07 11:46:00.177568 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:46:00.177537    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7034d671_5d18_41b6_bc4e_3ad1290abc3d.slice/crio-34c59dcb433ca533573c8795054681cc18de9402c3b61ccdf210269522bbacd5 WatchSource:0}: Error finding container 34c59dcb433ca533573c8795054681cc18de9402c3b61ccdf210269522bbacd5: Status 404 returned error can't find the container with id 34c59dcb433ca533573c8795054681cc18de9402c3b61ccdf210269522bbacd5
Jul 07 11:46:00.575061 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:00.575023    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj" event={"ID":"7034d671-5d18-41b6-bc4e-3ad1290abc3d","Type":"ContainerStarted","Data":"34c59dcb433ca533573c8795054681cc18de9402c3b61ccdf210269522bbacd5"}
Jul 07 11:46:03.588903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.588871    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj" event={"ID":"7034d671-5d18-41b6-bc4e-3ad1290abc3d","Type":"ContainerStarted","Data":"45563bdf2a3590b04afaa6c865bbef05a4552e38751178dd823c78ee6c212c46"}
Jul 07 11:46:03.589291 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.588998    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:46:03.613647 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.613604    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj" podStartSLOduration=1.948861301 podStartE2EDuration="4.613591399s" totalImagesPullingTime="2.664730098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:45:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:46:03.611544358 +0000 UTC m=+351.941494912" watchObservedRunningTime="2026-07-07 11:46:03.613591399 +0000 UTC m=+351.943541952"
Jul 07 11:46:03.732338 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.732309    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-fqt9j"]
Jul 07 11:46:03.734368 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.734351    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.739802 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.739782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 07 11:46:03.739900 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.739828    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-299vm\""
Jul 07 11:46:03.740344 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.740325    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 07 11:46:03.748052 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.748027    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-fqt9j"]
Jul 07 11:46:03.793253 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.793226    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4twh\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-kube-api-access-l4twh\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.793253 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.793254    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.793424 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.793279    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87334ba1-948b-402d-9fec-be1a473e8e91-cabundle0\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.894171 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.894086    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87334ba1-948b-402d-9fec-be1a473e8e91-cabundle0\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.894171 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.894149    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4twh\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-kube-api-access-l4twh\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.894171 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.894172    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.894344 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:03.894264    2573 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 07 11:46:03.894344 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:03.894277    2573 secret.go:281] references non-existent secret key: ca.crt
Jul 07 11:46:03.894344 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:03.894284    2573 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 07 11:46:03.894344 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:03.894296    2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-fqt9j: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 07 11:46:03.894482 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:03.894360    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates podName:87334ba1-948b-402d-9fec-be1a473e8e91 nodeName:}" failed. No retries permitted until 2026-07-07 11:46:04.39434505 +0000 UTC m=+352.724295581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates") pod "keda-operator-68bff59c-fqt9j" (UID: "87334ba1-948b-402d-9fec-be1a473e8e91") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 07 11:46:03.894710 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.894694    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/87334ba1-948b-402d-9fec-be1a473e8e91-cabundle0\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:03.917911 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:03.917888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4twh\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-kube-api-access-l4twh\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:04.348488 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.348456    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"]
Jul 07 11:46:04.350476 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.350459    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.353163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.353148    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 07 11:46:04.378314 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.378287    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"]
Jul 07 11:46:04.397557 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.397531    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-certificates\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.397652 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.397568    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:04.397692 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.397674    2573 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 07 11:46:04.397724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.397685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkfcw\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-kube-api-access-pkfcw\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.397724 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.397697    2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-fqt9j: secret "keda-operator-certs" not found
Jul 07 11:46:04.397793 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.397762    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates podName:87334ba1-948b-402d-9fec-be1a473e8e91 nodeName:}" failed. No retries permitted until 2026-07-07 11:46:05.397744499 +0000 UTC m=+353.727695047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates") pod "keda-operator-68bff59c-fqt9j" (UID: "87334ba1-948b-402d-9fec-be1a473e8e91") : secret "keda-operator-certs" not found
Jul 07 11:46:04.397793 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.397781    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6a73a7c8-48d1-4a42-8859-d28811d2ec13-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.498607 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.498573    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-certificates\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.498736 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.498632    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkfcw\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-kube-api-access-pkfcw\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.498736 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.498679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6a73a7c8-48d1-4a42-8859-d28811d2ec13-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.499097 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.499080    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/6a73a7c8-48d1-4a42-8859-d28811d2ec13-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.501165 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.501143    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-certificates\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.510730 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.510705    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkfcw\" (UniqueName: \"kubernetes.io/projected/6a73a7c8-48d1-4a42-8859-d28811d2ec13-kube-api-access-pkfcw\") pod \"keda-metrics-apiserver-559f75f947-7g9xr\" (UID: \"6a73a7c8-48d1-4a42-8859-d28811d2ec13\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.643366 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.643286    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w5wpp"]
Jul 07 11:46:04.645784 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.645767    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:04.648031 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.648011    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 07 11:46:04.659910 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.659886    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w5wpp"]
Jul 07 11:46:04.661101 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.661083    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:04.700606 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.700575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw6nx\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-kube-api-access-sw6nx\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:04.700758 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.700706    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:04.793084 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.792995    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"]
Jul 07 11:46:04.795527 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:46:04.795486    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a73a7c8_48d1_4a42_8859_d28811d2ec13.slice/crio-41b4ee7e8313be9eccc4a1eb85b27c0f7f3019f85c04754643a208c41017a78a WatchSource:0}: Error finding container 41b4ee7e8313be9eccc4a1eb85b27c0f7f3019f85c04754643a208c41017a78a: Status 404 returned error can't find the container with id 41b4ee7e8313be9eccc4a1eb85b27c0f7f3019f85c04754643a208c41017a78a
Jul 07 11:46:04.801465 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.801444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:04.801631 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.801608    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw6nx\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-kube-api-access-sw6nx\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:04.801631 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.801621    2573 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 07 11:46:04.801736 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.801644    2573 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-5fbd5c4644-w5wpp: secret "keda-admission-webhooks-certs" not found
Jul 07 11:46:04.801736 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:46:04.801685    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates podName:d88d064f-3d16-459b-aef6-a535fc58fcdd nodeName:}" failed. No retries permitted until 2026-07-07 11:46:05.30167068 +0000 UTC m=+353.631621235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates") pod "keda-admission-5fbd5c4644-w5wpp" (UID: "d88d064f-3d16-459b-aef6-a535fc58fcdd") : secret "keda-admission-webhooks-certs" not found
Jul 07 11:46:04.809989 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:04.809970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw6nx\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-kube-api-access-sw6nx\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:05.306177 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.306146    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:05.308624 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.308603    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d88d064f-3d16-459b-aef6-a535fc58fcdd-certificates\") pod \"keda-admission-5fbd5c4644-w5wpp\" (UID: \"d88d064f-3d16-459b-aef6-a535fc58fcdd\") " pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:05.407108 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.407079    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:05.409381 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.409361    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/87334ba1-948b-402d-9fec-be1a473e8e91-certificates\") pod \"keda-operator-68bff59c-fqt9j\" (UID: \"87334ba1-948b-402d-9fec-be1a473e8e91\") " pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:05.544452 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.544424    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:05.558470 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.558368    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:05.599383 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.599275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr" event={"ID":"6a73a7c8-48d1-4a42-8859-d28811d2ec13","Type":"ContainerStarted","Data":"41b4ee7e8313be9eccc4a1eb85b27c0f7f3019f85c04754643a208c41017a78a"}
Jul 07 11:46:05.733907 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.733844    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-w5wpp"]
Jul 07 11:46:05.737469 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:46:05.737426    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd88d064f_3d16_459b_aef6_a535fc58fcdd.slice/crio-8028ad55aea45571da8bf2b2221a33f1904240877a0813791a05163c41a9084b WatchSource:0}: Error finding container 8028ad55aea45571da8bf2b2221a33f1904240877a0813791a05163c41a9084b: Status 404 returned error can't find the container with id 8028ad55aea45571da8bf2b2221a33f1904240877a0813791a05163c41a9084b
Jul 07 11:46:05.916050 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:05.916026    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-fqt9j"]
Jul 07 11:46:05.918697 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:46:05.918666    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87334ba1_948b_402d_9fec_be1a473e8e91.slice/crio-cfe24851e5709f989bc3834974f6713a32a8c54e310f7302c9829e3582efd89b WatchSource:0}: Error finding container cfe24851e5709f989bc3834974f6713a32a8c54e310f7302c9829e3582efd89b: Status 404 returned error can't find the container with id cfe24851e5709f989bc3834974f6713a32a8c54e310f7302c9829e3582efd89b
Jul 07 11:46:06.605796 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:06.605714    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp" event={"ID":"d88d064f-3d16-459b-aef6-a535fc58fcdd","Type":"ContainerStarted","Data":"8028ad55aea45571da8bf2b2221a33f1904240877a0813791a05163c41a9084b"}
Jul 07 11:46:06.607197 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:06.607166    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-fqt9j" event={"ID":"87334ba1-948b-402d-9fec-be1a473e8e91","Type":"ContainerStarted","Data":"cfe24851e5709f989bc3834974f6713a32a8c54e310f7302c9829e3582efd89b"}
Jul 07 11:46:08.617654 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.617619    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr" event={"ID":"6a73a7c8-48d1-4a42-8859-d28811d2ec13","Type":"ContainerStarted","Data":"c4827aa85f8c2ebe6f282ce9391a1c79b8118aaee0910df5cbaa6b87c4a2ae26"}
Jul 07 11:46:08.618112 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.617782    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:08.619482 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.619455    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp" event={"ID":"d88d064f-3d16-459b-aef6-a535fc58fcdd","Type":"ContainerStarted","Data":"8a372f7d2814d92ac9198f92ad415f3b034cd2f3edc3c6f5559e3f2a7d51cfd9"}
Jul 07 11:46:08.619649 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.619609    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:08.639378 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.639337    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr" podStartSLOduration=1.574098231 podStartE2EDuration="4.63932247s" totalImagesPullingTime="3.065224239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:46:08.639173287 +0000 UTC m=+356.969123835" watchObservedRunningTime="2026-07-07 11:46:08.63932247 +0000 UTC m=+356.969273023"
Jul 07 11:46:08.663184 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:08.663142    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp" podStartSLOduration=2.543131998 podStartE2EDuration="4.663124337s" totalImagesPullingTime="2.119992339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:46:08.660694019 +0000 UTC m=+356.990644573" watchObservedRunningTime="2026-07-07 11:46:08.663124337 +0000 UTC m=+356.993074893"
Jul 07 11:46:09.627993 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:09.627957    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-fqt9j" event={"ID":"87334ba1-948b-402d-9fec-be1a473e8e91","Type":"ContainerStarted","Data":"40401636dfe6836df783524a39a2f3ea283e81af6cf77fd664fb50a111c06da1"}
Jul 07 11:46:09.644835 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:09.644785    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-fqt9j" podStartSLOduration=3.591486527 podStartE2EDuration="6.64476539s" totalImagesPullingTime="3.053278863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:46:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:46:09.644251409 +0000 UTC m=+357.974201975" watchObservedRunningTime="2026-07-07 11:46:09.64476539 +0000 UTC m=+357.974715943"
Jul 07 11:46:10.632665 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:10.632636    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:46:19.632262 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:19.632231    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-7g9xr"
Jul 07 11:46:24.595489 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:24.595462    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-8g7zj"
Jul 07 11:46:29.630293 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:29.630263    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-w5wpp"
Jul 07 11:46:31.638573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:46:31.638544    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-fqt9j"
Jul 07 11:47:22.891390 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.891354    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:47:22.893461 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.893440    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:22.901735 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.901717    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 07 11:47:22.902769 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.902749    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 07 11:47:22.902876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.902769    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 07 11:47:22.902876 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.902749    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-t7rf9\""
Jul 07 11:47:22.916059 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.916036    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:47:22.927883 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.927857    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"]
Jul 07 11:47:22.930475 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.930456    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:22.934342 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.934326    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 07 11:47:22.934447 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.934359    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-fl9l4\""
Jul 07 11:47:22.957321 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.957297    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-9nlxz"]
Jul 07 11:47:22.959934 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.959914    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:22.970691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.970670    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 07 11:47:22.970793 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.970739    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-2smsb\""
Jul 07 11:47:22.973065 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.973046    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"]
Jul 07 11:47:22.991901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:22.991882    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9nlxz"]
Jul 07 11:47:23.004923 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.004904    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f3827668-3227-46cc-b9f3-254fd5dfd0e4-data\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.005021 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.004941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnzh9\" (UniqueName: \"kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.005021 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.004968    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.005021 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.004990    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8cx7\" (UniqueName: \"kubernetes.io/projected/f3827668-3227-46cc-b9f3-254fd5dfd0e4-kube-api-access-h8cx7\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.005021 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.005015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.005202 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.005068    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4gpt\" (UniqueName: \"kubernetes.io/projected/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-kube-api-access-q4gpt\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.106004 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.105973    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f3827668-3227-46cc-b9f3-254fd5dfd0e4-data\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.106163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106025    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnzh9\" (UniqueName: \"kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.106163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106061    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.106163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106096    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8cx7\" (UniqueName: \"kubernetes.io/projected/f3827668-3227-46cc-b9f3-254fd5dfd0e4-kube-api-access-h8cx7\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.106163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106118    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.106163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106144    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4gpt\" (UniqueName: \"kubernetes.io/projected/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-kube-api-access-q4gpt\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.106518 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:47:23.106198    2573 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 11:47:23.106518 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:47:23.106263    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert podName:1c5dd3cd-1690-4ad9-9a68-df4d84cc3406 nodeName:}" failed. No retries permitted until 2026-07-07 11:47:23.606243189 +0000 UTC m=+431.936193724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert") pod "llmisvc-controller-manager-67d95fdc48-zd7s5" (UID: "1c5dd3cd-1690-4ad9-9a68-df4d84cc3406") : secret "llmisvc-webhook-server-cert" not found
Jul 07 11:47:23.106518 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.106389    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f3827668-3227-46cc-b9f3-254fd5dfd0e4-data\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.108568 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.108546    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.121012 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.120990    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnzh9\" (UniqueName: \"kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9\") pod \"kserve-controller-manager-57676b4bd8-gcmhz\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") " pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.121251 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.121228    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4gpt\" (UniqueName: \"kubernetes.io/projected/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-kube-api-access-q4gpt\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.125044 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.125016    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8cx7\" (UniqueName: \"kubernetes.io/projected/f3827668-3227-46cc-b9f3-254fd5dfd0e4-kube-api-access-h8cx7\") pod \"seaweedfs-64568bcd49-9nlxz\" (UID: \"f3827668-3227-46cc-b9f3-254fd5dfd0e4\") " pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.203379 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.203353    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:23.269054 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.268960    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:23.364203 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.364182    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:47:23.366340 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:47:23.366316    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fdfb1d_87d2_427c_896f_c62633d72543.slice/crio-bb2e928aaf2d7dce8bb9d5a966fd75415d191605c3e90990db8e9530a6a43b69 WatchSource:0}: Error finding container bb2e928aaf2d7dce8bb9d5a966fd75415d191605c3e90990db8e9530a6a43b69: Status 404 returned error can't find the container with id bb2e928aaf2d7dce8bb9d5a966fd75415d191605c3e90990db8e9530a6a43b69
Jul 07 11:47:23.402749 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.402722    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-9nlxz"]
Jul 07 11:47:23.405977 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:47:23.405956    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3827668_3227_46cc_b9f3_254fd5dfd0e4.slice/crio-ceb752e6f4634495d8d82b2d97dd75155ea371706d20d624c1152425b5fe7bd7 WatchSource:0}: Error finding container ceb752e6f4634495d8d82b2d97dd75155ea371706d20d624c1152425b5fe7bd7: Status 404 returned error can't find the container with id ceb752e6f4634495d8d82b2d97dd75155ea371706d20d624c1152425b5fe7bd7
Jul 07 11:47:23.612436 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.612368    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.614679 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.614659    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c5dd3cd-1690-4ad9-9a68-df4d84cc3406-cert\") pod \"llmisvc-controller-manager-67d95fdc48-zd7s5\" (UID: \"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.839953 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.839713    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:23.940783 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.940703    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9nlxz" event={"ID":"f3827668-3227-46cc-b9f3-254fd5dfd0e4","Type":"ContainerStarted","Data":"ceb752e6f4634495d8d82b2d97dd75155ea371706d20d624c1152425b5fe7bd7"}
Jul 07 11:47:23.944410 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:23.944378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" event={"ID":"76fdfb1d-87d2-427c-896f-c62633d72543","Type":"ContainerStarted","Data":"bb2e928aaf2d7dce8bb9d5a966fd75415d191605c3e90990db8e9530a6a43b69"}
Jul 07 11:47:24.045801 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:24.045766    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"]
Jul 07 11:47:24.049967 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:47:24.049930    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1c5dd3cd_1690_4ad9_9a68_df4d84cc3406.slice/crio-c9a697d88ebd5ae22f51dc26049c6324801d2b9ace634540a8ca0bc469befc73 WatchSource:0}: Error finding container c9a697d88ebd5ae22f51dc26049c6324801d2b9ace634540a8ca0bc469befc73: Status 404 returned error can't find the container with id c9a697d88ebd5ae22f51dc26049c6324801d2b9ace634540a8ca0bc469befc73
Jul 07 11:47:24.951052 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:24.950979    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5" event={"ID":"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406","Type":"ContainerStarted","Data":"c9a697d88ebd5ae22f51dc26049c6324801d2b9ace634540a8ca0bc469befc73"}
Jul 07 11:47:28.972298 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.972264    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-9nlxz" event={"ID":"f3827668-3227-46cc-b9f3-254fd5dfd0e4","Type":"ContainerStarted","Data":"2cfb67ce15df9b4e03898885d65920e249e111f79363400baadc2a4ff66e044d"}
Jul 07 11:47:28.972752 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.972377    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:28.973903 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.973878    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" event={"ID":"76fdfb1d-87d2-427c-896f-c62633d72543","Type":"ContainerStarted","Data":"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"}
Jul 07 11:47:28.974030 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.973931    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:47:28.975293 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.975275    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5" event={"ID":"1c5dd3cd-1690-4ad9-9a68-df4d84cc3406","Type":"ContainerStarted","Data":"8c57ff836aa16ff6871ac3633d5d288deb1ebad654d80297676c478c592a0d7e"}
Jul 07 11:47:28.975404 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.975342    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:28.998467 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:28.998423    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-9nlxz" podStartSLOduration=2.295741428 podStartE2EDuration="6.998410099s" totalImagesPullingTime="4.702668671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:47:28.997356038 +0000 UTC m=+437.327306591" watchObservedRunningTime="2026-07-07 11:47:28.998410099 +0000 UTC m=+437.328360677"
Jul 07 11:47:29.021721 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:29.021682    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" podStartSLOduration=3.341945018 podStartE2EDuration="7.02167069s" totalImagesPullingTime="3.679725672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:47:29.02072326 +0000 UTC m=+437.350673812" watchObservedRunningTime="2026-07-07 11:47:29.02167069 +0000 UTC m=+437.351621243"
Jul 07 11:47:29.048822 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:29.048777    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5" podStartSLOduration=2.939143291 podStartE2EDuration="7.048761236s" totalImagesPullingTime="4.109617945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:47:29.047802741 +0000 UTC m=+437.377753296" watchObservedRunningTime="2026-07-07 11:47:29.048761236 +0000 UTC m=+437.378711789"
Jul 07 11:47:34.982536 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:34.982432    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-9nlxz"
Jul 07 11:47:53.171219 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.171180    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c447f467-tnspb"]
Jul 07 11:47:53.177603 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.177581    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.199956 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.199929    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c447f467-tnspb"]
Jul 07 11:47:53.355456 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btg7v\" (UniqueName: \"kubernetes.io/projected/3f6f97c0-5956-4942-8234-e5daf37d823d-kube-api-access-btg7v\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355456 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355458    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-oauth-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355480    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-trusted-ca-bundle\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355592    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-console-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355619    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355676 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-service-ca\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.355827 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.355688    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-oauth-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456179 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456153    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-console-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456308 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456190    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456308 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456213    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-service-ca\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456308 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456255    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-oauth-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456308 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456294    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btg7v\" (UniqueName: \"kubernetes.io/projected/3f6f97c0-5956-4942-8234-e5daf37d823d-kube-api-access-btg7v\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456572 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456323    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-oauth-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456572 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456352    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-trusted-ca-bundle\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456978 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456955    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-console-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.456978 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.456973    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-service-ca\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.457134 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.457078    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-oauth-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.457230 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.457212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f6f97c0-5956-4942-8234-e5daf37d823d-trusted-ca-bundle\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.458685 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.458664    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-oauth-config\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.458797 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.458776    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f6f97c0-5956-4942-8234-e5daf37d823d-console-serving-cert\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.466119 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.466088    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btg7v\" (UniqueName: \"kubernetes.io/projected/3f6f97c0-5956-4942-8234-e5daf37d823d-kube-api-access-btg7v\") pod \"console-7c447f467-tnspb\" (UID: \"3f6f97c0-5956-4942-8234-e5daf37d823d\") " pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.486077 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.486054    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:47:53.626633 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:53.626611    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c447f467-tnspb"]
Jul 07 11:47:53.628996 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:47:53.628968    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6f97c0_5956_4942_8234_e5daf37d823d.slice/crio-334cc69bc562a82e373ff213f6b48668482f7276fbb4d0d3b93a2fadd0223a09 WatchSource:0}: Error finding container 334cc69bc562a82e373ff213f6b48668482f7276fbb4d0d3b93a2fadd0223a09: Status 404 returned error can't find the container with id 334cc69bc562a82e373ff213f6b48668482f7276fbb4d0d3b93a2fadd0223a09
Jul 07 11:47:54.088767 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:54.088730    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c447f467-tnspb" event={"ID":"3f6f97c0-5956-4942-8234-e5daf37d823d","Type":"ContainerStarted","Data":"f90e725ae27d3f4e11017c650190cd6f3d66786f247582d47c598e7eb62fd6ff"}
Jul 07 11:47:54.088950 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:54.088794    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c447f467-tnspb" event={"ID":"3f6f97c0-5956-4942-8234-e5daf37d823d","Type":"ContainerStarted","Data":"334cc69bc562a82e373ff213f6b48668482f7276fbb4d0d3b93a2fadd0223a09"}
Jul 07 11:47:54.140769 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:54.140722    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c447f467-tnspb" podStartSLOduration=1.14070695 podStartE2EDuration="1.14070695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:47:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:47:54.120236929 +0000 UTC m=+462.450187482" watchObservedRunningTime="2026-07-07 11:47:54.14070695 +0000 UTC m=+462.470657502"
Jul 07 11:47:59.981539 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:59.981488    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-zd7s5"
Jul 07 11:47:59.984468 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:47:59.984446    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:48:01.597830 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.597800    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:48:01.598228 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.598015    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" podUID="76fdfb1d-87d2-427c-896f-c62633d72543" containerName="manager" containerID="cri-o://3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1" gracePeriod=10
Jul 07 11:48:01.618610 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.618583    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-54mlr"]
Jul 07 11:48:01.620793 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.620773    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.634247 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.634226    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-54mlr"]
Jul 07 11:48:01.820840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.820811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh99m\" (UniqueName: \"kubernetes.io/projected/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-kube-api-access-hh99m\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.820985 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.820859    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-cert\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.839978 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.839952    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:48:01.921714 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.921635    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnzh9\" (UniqueName: \"kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9\") pod \"76fdfb1d-87d2-427c-896f-c62633d72543\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") "
Jul 07 11:48:01.921714 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.921709    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert\") pod \"76fdfb1d-87d2-427c-896f-c62633d72543\" (UID: \"76fdfb1d-87d2-427c-896f-c62633d72543\") "
Jul 07 11:48:01.921916 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.921818    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh99m\" (UniqueName: \"kubernetes.io/projected/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-kube-api-access-hh99m\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.921916 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.921851    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-cert\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.923773 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.923720    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9" (OuterVolumeSpecName: "kube-api-access-nnzh9") pod "76fdfb1d-87d2-427c-896f-c62633d72543" (UID: "76fdfb1d-87d2-427c-896f-c62633d72543"). InnerVolumeSpecName "kube-api-access-nnzh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:48:01.923773 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.923733    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert" (OuterVolumeSpecName: "cert") pod "76fdfb1d-87d2-427c-896f-c62633d72543" (UID: "76fdfb1d-87d2-427c-896f-c62633d72543"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:48:01.924036 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.924018    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-cert\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.930279 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.930243    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh99m\" (UniqueName: \"kubernetes.io/projected/4e0d3272-fbd0-476c-963b-fd0e0cd163fe-kube-api-access-hh99m\") pod \"kserve-controller-manager-57676b4bd8-54mlr\" (UID: \"4e0d3272-fbd0-476c-963b-fd0e0cd163fe\") " pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:01.981309 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:01.981291    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:02.022886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.022862    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnzh9\" (UniqueName: \"kubernetes.io/projected/76fdfb1d-87d2-427c-896f-c62633d72543-kube-api-access-nnzh9\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:02.022886 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.022885    2573 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76fdfb1d-87d2-427c-896f-c62633d72543-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:02.105856 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.105831    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-54mlr"]
Jul 07 11:48:02.107887 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:48:02.107862    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0d3272_fbd0_476c_963b_fd0e0cd163fe.slice/crio-2ccdf8ffa09ba8bbe49a508511a4c6add5d70c42597d4a233d3109df6100cc24 WatchSource:0}: Error finding container 2ccdf8ffa09ba8bbe49a508511a4c6add5d70c42597d4a233d3109df6100cc24: Status 404 returned error can't find the container with id 2ccdf8ffa09ba8bbe49a508511a4c6add5d70c42597d4a233d3109df6100cc24
Jul 07 11:48:02.123457 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.123434    2573 generic.go:356] "Generic (PLEG): container finished" podID="76fdfb1d-87d2-427c-896f-c62633d72543" containerID="3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1" exitCode=0
Jul 07 11:48:02.123585 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.123473    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz"
Jul 07 11:48:02.123585 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.123514    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" event={"ID":"76fdfb1d-87d2-427c-896f-c62633d72543","Type":"ContainerDied","Data":"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"}
Jul 07 11:48:02.123585 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.123565    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-gcmhz" event={"ID":"76fdfb1d-87d2-427c-896f-c62633d72543","Type":"ContainerDied","Data":"bb2e928aaf2d7dce8bb9d5a966fd75415d191605c3e90990db8e9530a6a43b69"}
Jul 07 11:48:02.123753 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.123593    2573 scope.go:117] "RemoveContainer" containerID="3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"
Jul 07 11:48:02.124786 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.124762    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr" event={"ID":"4e0d3272-fbd0-476c-963b-fd0e0cd163fe","Type":"ContainerStarted","Data":"2ccdf8ffa09ba8bbe49a508511a4c6add5d70c42597d4a233d3109df6100cc24"}
Jul 07 11:48:02.132231 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.132212    2573 scope.go:117] "RemoveContainer" containerID="3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"
Jul 07 11:48:02.132484 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:48:02.132465    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1\": container with ID starting with 3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1 not found: ID does not exist" containerID="3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"
Jul 07 11:48:02.132564 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.132541    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1"} err="failed to get container status \"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1\": rpc error: code = NotFound desc = could not find container \"3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1\": container with ID starting with 3033ff21bdf6fcb69f435e27ba0d911572fe62bb828acb882df2e6a202bd4cd1 not found: ID does not exist"
Jul 07 11:48:02.158490 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.158465    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:48:02.161121 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.161100    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-57676b4bd8-gcmhz"]
Jul 07 11:48:02.173694 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:02.173650    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76fdfb1d-87d2-427c-896f-c62633d72543" path="/var/lib/kubelet/pods/76fdfb1d-87d2-427c-896f-c62633d72543/volumes"
Jul 07 11:48:03.131868 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.131838    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr" event={"ID":"4e0d3272-fbd0-476c-963b-fd0e0cd163fe","Type":"ContainerStarted","Data":"641112b7f81ca50ccf9fc67d048f4385710819ac46f0bd302ce54230bfc1fe36"}
Jul 07 11:48:03.132272 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.131953    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:03.149513 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.149450    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr" podStartSLOduration=1.703046557 podStartE2EDuration="2.149436124s" totalImagesPullingTime="446.389567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:48:03.146861675 +0000 UTC m=+471.476812228" watchObservedRunningTime="2026-07-07 11:48:03.149436124 +0000 UTC m=+471.479386677"
Jul 07 11:48:03.486160 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.486130    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:48:03.486320 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.486181    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:48:03.490976 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:03.490954    2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:48:04.141102 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:04.141074    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c447f467-tnspb"
Jul 07 11:48:04.217462 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:04.217432    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:48:29.237327 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.237268    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bffb4758c-nskkb" podUID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" containerName="console" containerID="cri-o://9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532" gracePeriod=15
Jul 07 11:48:29.476370 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.476345    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:48:29.531655 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531587    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531655 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531640    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgb92\" (UniqueName: \"kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531816 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531664    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531816 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531790    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531843    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531893 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531883    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.531981 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.531965    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca\") pod \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\" (UID: \"8e51f09d-431d-4b72-aa75-1ef55430e9b0\") "
Jul 07 11:48:29.532055 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532021    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:48:29.532189 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532153    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:48:29.532417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532267    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config" (OuterVolumeSpecName: "console-config") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:48:29.532417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532343    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-oauth-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.532417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532359    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.532417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532374    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.532417 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.532367    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:48:29.533816 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.533789    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92" (OuterVolumeSpecName: "kube-api-access-cgb92") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "kube-api-access-cgb92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:48:29.533816 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.533801    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:48:29.533948 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.533906    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e51f09d-431d-4b72-aa75-1ef55430e9b0" (UID: "8e51f09d-431d-4b72-aa75-1ef55430e9b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:48:29.633730 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.633711    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-oauth-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.633730 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.633730    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e51f09d-431d-4b72-aa75-1ef55430e9b0-service-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.633858 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.633739    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e51f09d-431d-4b72-aa75-1ef55430e9b0-console-serving-cert\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:29.633858 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:29.633748    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgb92\" (UniqueName: \"kubernetes.io/projected/8e51f09d-431d-4b72-aa75-1ef55430e9b0-kube-api-access-cgb92\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:48:30.248459 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.248427    2573 generic.go:356] "Generic (PLEG): container finished" podID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" containerID="9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532" exitCode=0
Jul 07 11:48:30.248823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.248488    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bffb4758c-nskkb"
Jul 07 11:48:30.248823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.248521    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bffb4758c-nskkb" event={"ID":"8e51f09d-431d-4b72-aa75-1ef55430e9b0","Type":"ContainerDied","Data":"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"}
Jul 07 11:48:30.248823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.248570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bffb4758c-nskkb" event={"ID":"8e51f09d-431d-4b72-aa75-1ef55430e9b0","Type":"ContainerDied","Data":"495df5c990b24e75e3c3081db50700ee9a68605f61770e94b1a90147c6426635"}
Jul 07 11:48:30.248823 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.248590    2573 scope.go:117] "RemoveContainer" containerID="9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"
Jul 07 11:48:30.256638 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.256624    2573 scope.go:117] "RemoveContainer" containerID="9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"
Jul 07 11:48:30.256935 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:48:30.256915    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532\": container with ID starting with 9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532 not found: ID does not exist" containerID="9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"
Jul 07 11:48:30.256992 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.256944    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532"} err="failed to get container status \"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532\": rpc error: code = NotFound desc = could not find container \"9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532\": container with ID starting with 9bfca348bec89684817a85bae6fa10d75bcb84e95fde8b09944890c42d71c532 not found: ID does not exist"
Jul 07 11:48:30.264815 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.264793    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:48:30.269249 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:30.269231    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bffb4758c-nskkb"]
Jul 07 11:48:32.173845 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:32.173814    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" path="/var/lib/kubelet/pods/8e51f09d-431d-4b72-aa75-1ef55430e9b0/volumes"
Jul 07 11:48:34.142163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:34.142137    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-57676b4bd8-54mlr"
Jul 07 11:48:35.189345 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189314    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-9zshz"]
Jul 07 11:48:35.189724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189667    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76fdfb1d-87d2-427c-896f-c62633d72543" containerName="manager"
Jul 07 11:48:35.189724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189680    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="76fdfb1d-87d2-427c-896f-c62633d72543" containerName="manager"
Jul 07 11:48:35.189724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189700    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" containerName="console"
Jul 07 11:48:35.189724 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189706    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" containerName="console"
Jul 07 11:48:35.189849 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189750    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e51f09d-431d-4b72-aa75-1ef55430e9b0" containerName="console"
Jul 07 11:48:35.189849 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.189761    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="76fdfb1d-87d2-427c-896f-c62633d72543" containerName="manager"
Jul 07 11:48:35.192516 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.192486    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.195517 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.195483    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 07 11:48:35.195743 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.195729    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-clgs9\""
Jul 07 11:48:35.217902 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.217879    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-9zshz"]
Jul 07 11:48:35.277462 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.277440    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.277576 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.277479    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2bp\" (UniqueName: \"kubernetes.io/projected/e8830845-dd8f-45ca-811e-0f9118437880-kube-api-access-bw2bp\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.378325 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.378290    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.378436 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.378342    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2bp\" (UniqueName: \"kubernetes.io/projected/e8830845-dd8f-45ca-811e-0f9118437880-kube-api-access-bw2bp\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.378527 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:48:35.378437    2573 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 07 11:48:35.378575 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:48:35.378536    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs podName:e8830845-dd8f-45ca-811e-0f9118437880 nodeName:}" failed. No retries permitted until 2026-07-07 11:48:35.878515809 +0000 UTC m=+504.208466357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs") pod "model-serving-api-fd65d7d6-9zshz" (UID: "e8830845-dd8f-45ca-811e-0f9118437880") : secret "model-serving-api-tls" not found
Jul 07 11:48:35.391584 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.391564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2bp\" (UniqueName: \"kubernetes.io/projected/e8830845-dd8f-45ca-811e-0f9118437880-kube-api-access-bw2bp\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.882540 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.882509    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:35.884828 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:35.884802    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8830845-dd8f-45ca-811e-0f9118437880-tls-certs\") pod \"model-serving-api-fd65d7d6-9zshz\" (UID: \"e8830845-dd8f-45ca-811e-0f9118437880\") " pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:36.107504 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:36.107474    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:36.233518 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:36.233474    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-9zshz"]
Jul 07 11:48:36.235326 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:48:36.235298    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8830845_dd8f_45ca_811e_0f9118437880.slice/crio-1e62d9bbfb5db4e1782febbb098c696d5cb5606113a7e77ae035545ed959c70e WatchSource:0}: Error finding container 1e62d9bbfb5db4e1782febbb098c696d5cb5606113a7e77ae035545ed959c70e: Status 404 returned error can't find the container with id 1e62d9bbfb5db4e1782febbb098c696d5cb5606113a7e77ae035545ed959c70e
Jul 07 11:48:36.274535 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:36.274488    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-9zshz" event={"ID":"e8830845-dd8f-45ca-811e-0f9118437880","Type":"ContainerStarted","Data":"1e62d9bbfb5db4e1782febbb098c696d5cb5606113a7e77ae035545ed959c70e"}
Jul 07 11:48:38.285234 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:38.285192    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-9zshz" event={"ID":"e8830845-dd8f-45ca-811e-0f9118437880","Type":"ContainerStarted","Data":"ddd99100e69e5a73a04c9d2a0c0f41ed18cd7cef0ac04f6239e9046f549c6395"}
Jul 07 11:48:38.285644 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:38.285310    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:48:38.302151 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:38.302106    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-9zshz" podStartSLOduration=1.81182894 podStartE2EDuration="3.30209245s" totalImagesPullingTime="1.49026351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:48:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:48:38.301154681 +0000 UTC m=+506.631105236" watchObservedRunningTime="2026-07-07 11:48:38.30209245 +0000 UTC m=+506.632043037"
Jul 07 11:48:49.293902 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:48:49.293877    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-9zshz"
Jul 07 11:50:21.551729 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.551685    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:50:21.554965 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.554949    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.557366 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.557341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7cc25-kube-rbac-proxy-sar-config\""
Jul 07 11:50:21.557366 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.557341    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 07 11:50:21.558800 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.558777    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 07 11:50:21.558908 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.558802    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-pntcj\""
Jul 07 11:50:21.558908 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.558782    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-7cc25-predictor-serving-cert\""
Jul 07 11:50:21.565556 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.565536    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:50:21.605567 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.605539    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgb8w\" (UniqueName: \"kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.605692 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.605638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.605692 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.605680    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.706831 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.706799    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.706976 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.706844    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.706976 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.706886    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgb8w\" (UniqueName: \"kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.707090 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:50:21.706972    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-serving-cert: secret "error-404-isvc-7cc25-predictor-serving-cert" not found
Jul 07 11:50:21.707090 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:50:21.707045    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls podName:42b0c064-7c7a-4c74-aaf2-f6662695b6c6 nodeName:}" failed. No retries permitted until 2026-07-07 11:50:22.207023724 +0000 UTC m=+610.536974272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls") pod "error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" (UID: "42b0c064-7c7a-4c74-aaf2-f6662695b6c6") : secret "error-404-isvc-7cc25-predictor-serving-cert" not found
Jul 07 11:50:21.707579 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.707561    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:21.715019 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:21.714996    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgb8w\" (UniqueName: \"kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:22.211995 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:22.211965    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:22.214317 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:22.214297    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") pod \"error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") " pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:22.466163 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:22.466069    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:22.596935 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:22.596912    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:50:22.598642 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:50:22.598610    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b0c064_7c7a_4c74_aaf2_f6662695b6c6.slice/crio-61d0495f6094c79c110863c0e4da20223804d0255e56b7e9bcb66ef35d0077a3 WatchSource:0}: Error finding container 61d0495f6094c79c110863c0e4da20223804d0255e56b7e9bcb66ef35d0077a3: Status 404 returned error can't find the container with id 61d0495f6094c79c110863c0e4da20223804d0255e56b7e9bcb66ef35d0077a3
Jul 07 11:50:22.724885 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:22.724810    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerStarted","Data":"61d0495f6094c79c110863c0e4da20223804d0255e56b7e9bcb66ef35d0077a3"}
Jul 07 11:50:33.919759 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:33.919738    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 11:50:34.797655 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:34.797611    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerStarted","Data":"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"}
Jul 07 11:50:36.811210 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:36.811175    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerStarted","Data":"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"}
Jul 07 11:50:36.811623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:36.811265    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:36.811623 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:36.811297    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:36.812573 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:36.812539    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:50:36.830867 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:36.830821    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podStartSLOduration=2.253866281 podStartE2EDuration="15.830808308s" totalImagesPullingTime="13.576942027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:50:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:50:36.829471758 +0000 UTC m=+625.159422317" watchObservedRunningTime="2026-07-07 11:50:36.830808308 +0000 UTC m=+625.160758861"
Jul 07 11:50:37.815440 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:37.815401    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:50:42.820020 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:42.819988    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:50:42.820682 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:42.820647    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:50:52.821353 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:50:52.821313    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:51:02.820726 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:02.820686    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:51:12.820935 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:12.820898    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:51:22.821052 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:22.821025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:51:51.614664 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.614630    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 11:51:51.616840 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.616826    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.619129 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.619108    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5e1d2-predictor-serving-cert\""
Jul 07 11:51:51.619403 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.619388    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5e1d2-kube-rbac-proxy-sar-config\""
Jul 07 11:51:51.630990 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.630969    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 11:51:51.669146 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.669122    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:51:51.669339 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.669317    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" containerID="cri-o://691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9" gracePeriod=30
Jul 07 11:51:51.669410 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.669349    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kube-rbac-proxy" containerID="cri-o://150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3" gracePeriod=30
Jul 07 11:51:51.784592 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.784563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.784737 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.784603    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sn9f\" (UniqueName: \"kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.784737 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.784668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.886073 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.886004    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.886073 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.886040    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sn9f\" (UniqueName: \"kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.886274 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.886081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.886616 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.886597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.888401 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.888379    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.895000 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.894974    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sn9f\" (UniqueName: \"kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f\") pod \"error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") " pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:51.928737 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:51.928709    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:52.060270 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.060238    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 11:51:52.063109 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:51:52.063082    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ac480c0_0f5f_4f0d_8e0b_04bf0897c9c1.slice/crio-d9674c3ce7b1047b29292f763df004df4beb50ce4395e7dd3f6094f0a97e2127 WatchSource:0}: Error finding container d9674c3ce7b1047b29292f763df004df4beb50ce4395e7dd3f6094f0a97e2127: Status 404 returned error can't find the container with id d9674c3ce7b1047b29292f763df004df4beb50ce4395e7dd3f6094f0a97e2127
Jul 07 11:51:52.141532 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.141485    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerStarted","Data":"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"}
Jul 07 11:51:52.141638 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.141564    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerStarted","Data":"d9674c3ce7b1047b29292f763df004df4beb50ce4395e7dd3f6094f0a97e2127"}
Jul 07 11:51:52.143365 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.143344    2573 generic.go:356] "Generic (PLEG): container finished" podID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerID="150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3" exitCode=2
Jul 07 11:51:52.143456 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.143416    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerDied","Data":"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"}
Jul 07 11:51:52.816481 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.816433    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.32:8643/healthz\": dial tcp 10.133.0.32:8643: connect: connection refused"
Jul 07 11:51:52.820821 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:52.820794    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.32:8080: connect: connection refused"
Jul 07 11:51:53.149002 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:53.148912    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerStarted","Data":"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"}
Jul 07 11:51:53.149150 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:53.149067    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:53.149228 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:53.149210    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:53.150574 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:53.150549    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:51:53.168777 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:53.168722    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podStartSLOduration=2.168706031 podStartE2EDuration="2.168706031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:51:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:51:53.168145444 +0000 UTC m=+701.498095997" watchObservedRunningTime="2026-07-07 11:51:53.168706031 +0000 UTC m=+701.498656588"
Jul 07 11:51:54.153231 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.153190    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:51:54.520377 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.520354    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:51:54.611017 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.610988    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") pod \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") "
Jul 07 11:51:54.611164 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.611024    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgb8w\" (UniqueName: \"kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w\") pod \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") "
Jul 07 11:51:54.611164 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.611071    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config\") pod \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\" (UID: \"42b0c064-7c7a-4c74-aaf2-f6662695b6c6\") "
Jul 07 11:51:54.611487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.611456    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "42b0c064-7c7a-4c74-aaf2-f6662695b6c6" (UID: "42b0c064-7c7a-4c74-aaf2-f6662695b6c6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 11:51:54.613081 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.613059    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "42b0c064-7c7a-4c74-aaf2-f6662695b6c6" (UID: "42b0c064-7c7a-4c74-aaf2-f6662695b6c6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 11:51:54.613153 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.613105    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w" (OuterVolumeSpecName: "kube-api-access-zgb8w") pod "42b0c064-7c7a-4c74-aaf2-f6662695b6c6" (UID: "42b0c064-7c7a-4c74-aaf2-f6662695b6c6"). InnerVolumeSpecName "kube-api-access-zgb8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 11:51:54.711901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.711840    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgb8w\" (UniqueName: \"kubernetes.io/projected/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-api-access-zgb8w\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:51:54.711901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.711861    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:51:54.711901 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:54.711871    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/42b0c064-7c7a-4c74-aaf2-f6662695b6c6-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 11:51:55.158723 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.158634    2573 generic.go:356] "Generic (PLEG): container finished" podID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerID="691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9" exitCode=0
Jul 07 11:51:55.158723 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.158671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerDied","Data":"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"}
Jul 07 11:51:55.158723 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.158699    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"
Jul 07 11:51:55.159254 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.158782    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2" event={"ID":"42b0c064-7c7a-4c74-aaf2-f6662695b6c6","Type":"ContainerDied","Data":"61d0495f6094c79c110863c0e4da20223804d0255e56b7e9bcb66ef35d0077a3"}
Jul 07 11:51:55.159254 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.158826    2573 scope.go:117] "RemoveContainer" containerID="150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"
Jul 07 11:51:55.167778 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.167762    2573 scope.go:117] "RemoveContainer" containerID="691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"
Jul 07 11:51:55.174988 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.174972    2573 scope.go:117] "RemoveContainer" containerID="150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"
Jul 07 11:51:55.175241 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:51:55.175225    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3\": container with ID starting with 150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3 not found: ID does not exist" containerID="150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"
Jul 07 11:51:55.175286 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.175248    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3"} err="failed to get container status \"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3\": rpc error: code = NotFound desc = could not find container \"150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3\": container with ID starting with 150a4f862e9ab0b2c58df6f1e212fb62c6a6eaff11434b8bf105c7b5014be3e3 not found: ID does not exist"
Jul 07 11:51:55.175286 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.175264    2573 scope.go:117] "RemoveContainer" containerID="691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"
Jul 07 11:51:55.175518 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:51:55.175479    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9\": container with ID starting with 691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9 not found: ID does not exist" containerID="691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"
Jul 07 11:51:55.175578 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.175527    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9"} err="failed to get container status \"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9\": rpc error: code = NotFound desc = could not find container \"691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9\": container with ID starting with 691041936dc33becb7f9c2e820f7933a60924f1cedd3758eb56a881e5553f1e9 not found: ID does not exist"
Jul 07 11:51:55.187760 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.187739    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:51:55.190084 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:55.190065    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-7cc25-predictor-f8874b7c6-5r6t2"]
Jul 07 11:51:56.172978 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:56.172943    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" path="/var/lib/kubelet/pods/42b0c064-7c7a-4c74-aaf2-f6662695b6c6/volumes"
Jul 07 11:51:59.157630 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:59.157604    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:51:59.158069 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:51:59.158045    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:52:09.158448 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:09.158367    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:52:19.158896 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:19.158858    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:52:29.158259 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:29.158223    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 11:52:39.159398 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:39.159364    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 11:52:41.621447 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621416    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 11:52:41.621818 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621769    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container"
Jul 07 11:52:41.621818 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621781    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container"
Jul 07 11:52:41.621818 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621801    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kube-rbac-proxy"
Jul 07 11:52:41.621818 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621806    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kube-rbac-proxy"
Jul 07 11:52:41.621945 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621865    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kube-rbac-proxy"
Jul 07 11:52:41.621945 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.621874    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b0c064-7c7a-4c74-aaf2-f6662695b6c6" containerName="kserve-container"
Jul 07 11:52:41.623868 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.623853    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.627388 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.627364    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-07b43-kube-rbac-proxy-sar-config\""
Jul 07 11:52:41.627567 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.627423    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-07b43-predictor-serving-cert\""
Jul 07 11:52:41.633521 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.633482    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 11:52:41.799487 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.799456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.799691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.799527    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lnff\" (UniqueName: \"kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.799691 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.799572    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.900156 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.900071    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.900156 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.900140    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.900353 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.900193    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lnff\" (UniqueName: \"kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.900353 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:52:41.900308    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-07b43-predictor-serving-cert: secret "error-404-isvc-07b43-predictor-serving-cert" not found
Jul 07 11:52:41.900452 ip-10-0-138-101 kubenswrapper[2573]: E0707 11:52:41.900373    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls podName:90900607-246e-432f-8a01-324185f78e92 nodeName:}" failed. No retries permitted until 2026-07-07 11:52:42.400358228 +0000 UTC m=+750.730308759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls") pod "error-404-isvc-07b43-predictor-755cf86f9b-hzktj" (UID: "90900607-246e-432f-8a01-324185f78e92") : secret "error-404-isvc-07b43-predictor-serving-cert" not found
Jul 07 11:52:41.900829 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.900810    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:41.908617 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:41.908592    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lnff\" (UniqueName: \"kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:42.403961 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:42.403924    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:42.406201 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:42.406174    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") pod \"error-404-isvc-07b43-predictor-755cf86f9b-hzktj\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") " pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:42.534615 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:42.534572    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:42.665041 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:42.664975    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 11:52:42.668130 ip-10-0-138-101 kubenswrapper[2573]: W0707 11:52:42.668102    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90900607_246e_432f_8a01_324185f78e92.slice/crio-73150f2c4d6a3a0ffa468ab8085f24eb8eeac41922753460e04a42dd7bb4e859 WatchSource:0}: Error finding container 73150f2c4d6a3a0ffa468ab8085f24eb8eeac41922753460e04a42dd7bb4e859: Status 404 returned error can't find the container with id 73150f2c4d6a3a0ffa468ab8085f24eb8eeac41922753460e04a42dd7bb4e859
Jul 07 11:52:43.362370 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:43.362337    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerStarted","Data":"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"}
Jul 07 11:52:43.362581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:43.362406    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerStarted","Data":"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"}
Jul 07 11:52:43.362581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:43.362437    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerStarted","Data":"73150f2c4d6a3a0ffa468ab8085f24eb8eeac41922753460e04a42dd7bb4e859"}
Jul 07 11:52:43.362581 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:43.362470    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:43.381181 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:43.381128    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podStartSLOduration=2.38111347 podStartE2EDuration="2.38111347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 11:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 11:52:43.379984545 +0000 UTC m=+751.709935099" watchObservedRunningTime="2026-07-07 11:52:43.38111347 +0000 UTC m=+751.711064022"
Jul 07 11:52:44.366683 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:44.366653    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:44.368104 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:44.368076    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:52:45.371064 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:45.371024    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:52:50.376048 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:50.375962    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 11:52:50.376608 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:52:50.376577    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:53:00.377112 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:53:00.377075    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:53:10.376889 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:53:10.376848    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:53:20.377130 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:53:20.377085    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 11:53:30.377052 ip-10-0-138-101 kubenswrapper[2573]: I0707 11:53:30.377018    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 12:01:06.753043 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.752969    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:01:06.755206 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.755192    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.758682 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.758656    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-462dc-predictor-serving-cert\""
Jul 07 12:01:06.758812 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.758665    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-462dc-kube-rbac-proxy-sar-config\""
Jul 07 12:01:06.777609 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.777587    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:01:06.878400 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.878365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lpm\" (UniqueName: \"kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.878569 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.878414    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.878569 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.878535    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.936435 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.936400    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 12:01:06.936685 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.936660    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" containerID="cri-o://149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33" gracePeriod=30
Jul 07 12:01:06.936771 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.936745    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kube-rbac-proxy" containerID="cri-o://5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b" gracePeriod=30
Jul 07 12:01:06.979061 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.979037    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.979166 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.979081    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lpm\" (UniqueName: \"kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.979166 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.979133    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.979770 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.979749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:06.981302 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:06.981260    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:07.003947 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.003894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lpm\" (UniqueName: \"kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm\") pod \"error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") " pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:07.065545 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.065522    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:07.203666 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.203643    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:01:07.205632 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:01:07.205609    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44db145b_cc4e_4b01_8185_b17ddfcdc11a.slice/crio-5e121a6c300bac69878dda360822b519059633fe0dd7a92edf93411341982a73 WatchSource:0}: Error finding container 5e121a6c300bac69878dda360822b519059633fe0dd7a92edf93411341982a73: Status 404 returned error can't find the container with id 5e121a6c300bac69878dda360822b519059633fe0dd7a92edf93411341982a73
Jul 07 12:01:07.573119 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.573038    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerStarted","Data":"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"}
Jul 07 12:01:07.573119 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.573107    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:07.573332 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.573141    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerStarted","Data":"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"}
Jul 07 12:01:07.573332 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.573163    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerStarted","Data":"5e121a6c300bac69878dda360822b519059633fe0dd7a92edf93411341982a73"}
Jul 07 12:01:07.573332 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.573273    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:07.579661 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.579577    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:07.581329 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.581307    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerID="5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b" exitCode=2
Jul 07 12:01:07.581436 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.581371    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerDied","Data":"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"}
Jul 07 12:01:07.604521 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:07.604462    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podStartSLOduration=1.6044491870000002 podStartE2EDuration="1.604449187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:01:07.603546157 +0000 UTC m=+1255.933496711" watchObservedRunningTime="2026-07-07 12:01:07.604449187 +0000 UTC m=+1255.934399737"
Jul 07 12:01:08.585930 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:08.585884    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:09.153695 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:09.153650    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.33:8643/healthz\": dial tcp 10.133.0.33:8643: connect: connection refused"
Jul 07 12:01:09.159017 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:09.158985    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.33:8080: connect: connection refused"
Jul 07 12:01:09.883164 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:09.883139    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 12:01:10.004155 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.004080    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls\") pod \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") "
Jul 07 12:01:10.004271 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.004159    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config\") pod \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") "
Jul 07 12:01:10.004271 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.004190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sn9f\" (UniqueName: \"kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f\") pod \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\" (UID: \"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1\") "
Jul 07 12:01:10.004513 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.004463    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" (UID: "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:01:10.006152 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.006132    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f" (OuterVolumeSpecName: "kube-api-access-9sn9f") pod "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" (UID: "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1"). InnerVolumeSpecName "kube-api-access-9sn9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:01:10.006225 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.006174    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" (UID: "3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:01:10.105159 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.105127    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:01:10.105159 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.105154    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:01:10.105331 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.105166    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sn9f\" (UniqueName: \"kubernetes.io/projected/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1-kube-api-access-9sn9f\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:01:10.596191 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.596159    2573 generic.go:356] "Generic (PLEG): container finished" podID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerID="149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33" exitCode=0
Jul 07 12:01:10.596191 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.596194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerDied","Data":"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"}
Jul 07 12:01:10.596405 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.596212    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"
Jul 07 12:01:10.596405 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.596238    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq" event={"ID":"3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1","Type":"ContainerDied","Data":"d9674c3ce7b1047b29292f763df004df4beb50ce4395e7dd3f6094f0a97e2127"}
Jul 07 12:01:10.596405 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.596263    2573 scope.go:117] "RemoveContainer" containerID="5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"
Jul 07 12:01:10.604806 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.604789    2573 scope.go:117] "RemoveContainer" containerID="149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"
Jul 07 12:01:10.612189 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.612172    2573 scope.go:117] "RemoveContainer" containerID="5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"
Jul 07 12:01:10.612334 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.612316    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 12:01:10.612450 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:01:10.612432    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b\": container with ID starting with 5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b not found: ID does not exist" containerID="5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"
Jul 07 12:01:10.612488 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.612456    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b"} err="failed to get container status \"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b\": rpc error: code = NotFound desc = could not find container \"5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b\": container with ID starting with 5250f9dc3f4ed5d519dd3802f01bc7507080a7667e04c16c78f91789f60cdc7b not found: ID does not exist"
Jul 07 12:01:10.612488 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.612474    2573 scope.go:117] "RemoveContainer" containerID="149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"
Jul 07 12:01:10.612741 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:01:10.612724    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33\": container with ID starting with 149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33 not found: ID does not exist" containerID="149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"
Jul 07 12:01:10.612804 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.612745    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33"} err="failed to get container status \"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33\": rpc error: code = NotFound desc = could not find container \"149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33\": container with ID starting with 149a06d41f18d72e681e71f684c9d67c3c3624309990b7fadb78f71078af7d33 not found: ID does not exist"
Jul 07 12:01:10.616457 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:10.616437    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5e1d2-predictor-5cd9566866-r6bmq"]
Jul 07 12:01:12.173430 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:12.173399    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" path="/var/lib/kubelet/pods/3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1/volumes"
Jul 07 12:01:13.590446 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:13.590419    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:13.591010 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:13.590984    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:23.591587 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:23.591551    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:33.594826 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:33.594787    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:43.591266 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:43.591226    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.35:8080: connect: connection refused"
Jul 07 12:01:53.591615 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:53.591583    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:01:56.361953 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.361919    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:01:56.362390 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362307    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kube-rbac-proxy"
Jul 07 12:01:56.362390 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362321    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kube-rbac-proxy"
Jul 07 12:01:56.362390 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362333    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container"
Jul 07 12:01:56.362390 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362338    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container"
Jul 07 12:01:56.362547 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362393    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kserve-container"
Jul 07 12:01:56.362547 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.362400    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ac480c0-0f5f-4f0d-8e0b-04bf0897c9c1" containerName="kube-rbac-proxy"
Jul 07 12:01:56.365618 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.365588    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.367838 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.367820    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a4899-predictor-serving-cert\""
Jul 07 12:01:56.368395 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.368379    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-a4899-kube-rbac-proxy-sar-config\""
Jul 07 12:01:56.374644 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.374623    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:01:56.397730 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.397696    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 12:01:56.398010 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.397964    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" containerID="cri-o://0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591" gracePeriod=30
Jul 07 12:01:56.398092 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.397999    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kube-rbac-proxy" containerID="cri-o://90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd" gracePeriod=30
Jul 07 12:01:56.500530 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.500474    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.500679 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.500554    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.500679 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.500645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqtcs\" (UniqueName: \"kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.601383 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.601349    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqtcs\" (UniqueName: \"kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.601566 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.601406    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.601566 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.601444    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.602147 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.602124    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.603809 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.603788    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.617685 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.617637    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqtcs\" (UniqueName: \"kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs\") pod \"error-404-isvc-a4899-predictor-7c8d7697d6-w47mt\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") " pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.676655 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.676633    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:56.803461 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.803431    2573 generic.go:356] "Generic (PLEG): container finished" podID="90900607-246e-432f-8a01-324185f78e92" containerID="90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd" exitCode=2
Jul 07 12:01:56.803622 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.803522    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerDied","Data":"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"}
Jul 07 12:01:56.811375 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:56.811351    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:01:56.811535 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:01:56.811515    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7be029_4076_469e_8276_1195c8f7a0e6.slice/crio-0b7af5087841522467818238b8d9f5db76497e0fd898ca6ec1ab7d1e35a8b84e WatchSource:0}: Error finding container 0b7af5087841522467818238b8d9f5db76497e0fd898ca6ec1ab7d1e35a8b84e: Status 404 returned error can't find the container with id 0b7af5087841522467818238b8d9f5db76497e0fd898ca6ec1ab7d1e35a8b84e
Jul 07 12:01:57.809304 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:57.809270    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerStarted","Data":"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"}
Jul 07 12:01:57.809704 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:57.809327    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerStarted","Data":"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"}
Jul 07 12:01:57.809704 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:57.809354    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:57.809704 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:57.809372    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerStarted","Data":"0b7af5087841522467818238b8d9f5db76497e0fd898ca6ec1ab7d1e35a8b84e"}
Jul 07 12:01:57.830476 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:57.830423    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podStartSLOduration=1.830402775 podStartE2EDuration="1.830402775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:01:57.830050339 +0000 UTC m=+1306.160000891" watchObservedRunningTime="2026-07-07 12:01:57.830402775 +0000 UTC m=+1306.160353329"
Jul 07 12:01:58.814114 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:58.814089    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:01:58.815439 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:58.815411    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:01:59.818308 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:01:59.818271    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:02:00.371280 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:00.371236    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.34:8643/healthz\": dial tcp 10.133.0.34:8643: connect: connection refused"
Jul 07 12:02:00.376590 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:00.376564    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.34:8080: connect: connection refused"
Jul 07 12:02:02.747745 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.747723    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 12:02:02.833666 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.833579    2573 generic.go:356] "Generic (PLEG): container finished" podID="90900607-246e-432f-8a01-324185f78e92" containerID="0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591" exitCode=0
Jul 07 12:02:02.833830 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.833671    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerDied","Data":"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"}
Jul 07 12:02:02.833830 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.833688    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"
Jul 07 12:02:02.833830 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.833734    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj" event={"ID":"90900607-246e-432f-8a01-324185f78e92","Type":"ContainerDied","Data":"73150f2c4d6a3a0ffa468ab8085f24eb8eeac41922753460e04a42dd7bb4e859"}
Jul 07 12:02:02.833830 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.833771    2573 scope.go:117] "RemoveContainer" containerID="90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"
Jul 07 12:02:02.842369 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.842352    2573 scope.go:117] "RemoveContainer" containerID="0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"
Jul 07 12:02:02.849928 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.849913    2573 scope.go:117] "RemoveContainer" containerID="90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"
Jul 07 12:02:02.850184 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:02:02.850164    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd\": container with ID starting with 90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd not found: ID does not exist" containerID="90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"
Jul 07 12:02:02.850225 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.850187    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd"} err="failed to get container status \"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd\": rpc error: code = NotFound desc = could not find container \"90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd\": container with ID starting with 90f4d954a35c9734053f8e9f967cfcb0b3bc1413b923df958d155297d24933cd not found: ID does not exist"
Jul 07 12:02:02.850225 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.850203    2573 scope.go:117] "RemoveContainer" containerID="0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"
Jul 07 12:02:02.850452 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:02:02.850426    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591\": container with ID starting with 0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591 not found: ID does not exist" containerID="0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"
Jul 07 12:02:02.850507 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.850460    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591"} err="failed to get container status \"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591\": rpc error: code = NotFound desc = could not find container \"0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591\": container with ID starting with 0de84360839cfaf3905ab31b06f7d0f39ff3244f1e8af94bc5241540da877591 not found: ID does not exist"
Jul 07 12:02:02.851718 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.851694    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6lnff\" (UniqueName: \"kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff\") pod \"90900607-246e-432f-8a01-324185f78e92\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") "
Jul 07 12:02:02.851760 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.851738    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") pod \"90900607-246e-432f-8a01-324185f78e92\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") "
Jul 07 12:02:02.851760 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.851755    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config\") pod \"90900607-246e-432f-8a01-324185f78e92\" (UID: \"90900607-246e-432f-8a01-324185f78e92\") "
Jul 07 12:02:02.852118 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.852096    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "90900607-246e-432f-8a01-324185f78e92" (UID: "90900607-246e-432f-8a01-324185f78e92"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:02:02.853551 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.853533    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff" (OuterVolumeSpecName: "kube-api-access-6lnff") pod "90900607-246e-432f-8a01-324185f78e92" (UID: "90900607-246e-432f-8a01-324185f78e92"). InnerVolumeSpecName "kube-api-access-6lnff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:02:02.853790 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.853771    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "90900607-246e-432f-8a01-324185f78e92" (UID: "90900607-246e-432f-8a01-324185f78e92"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:02:02.953130 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.953098    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6lnff\" (UniqueName: \"kubernetes.io/projected/90900607-246e-432f-8a01-324185f78e92-kube-api-access-6lnff\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:02.953130 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.953125    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/90900607-246e-432f-8a01-324185f78e92-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:02.953130 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:02.953138    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/90900607-246e-432f-8a01-324185f78e92-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:03.155580 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:03.155549    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 12:02:03.161212 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:03.161190    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-07b43-predictor-755cf86f9b-hzktj"]
Jul 07 12:02:04.174133 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:04.174104    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90900607-246e-432f-8a01-324185f78e92" path="/var/lib/kubelet/pods/90900607-246e-432f-8a01-324185f78e92/volumes"
Jul 07 12:02:04.823330 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:04.823304    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:02:04.823822 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:04.823785    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:02:14.824613 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:14.824575    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:02:16.860963 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:16.860930    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:02:16.861395 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:16.861141    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container" containerID="cri-o://2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906" gracePeriod=30
Jul 07 12:02:16.861395 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:16.861208    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kube-rbac-proxy" containerID="cri-o://4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e" gracePeriod=30
Jul 07 12:02:17.079542 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.079505    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:02:17.079950 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.079933    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kube-rbac-proxy"
Jul 07 12:02:17.080041 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.079952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kube-rbac-proxy"
Jul 07 12:02:17.080041 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.079981    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container"
Jul 07 12:02:17.080041 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.079990    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container"
Jul 07 12:02:17.080200 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.080082    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kube-rbac-proxy"
Jul 07 12:02:17.080200 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.080097    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="90900607-246e-432f-8a01-324185f78e92" containerName="kserve-container"
Jul 07 12:02:17.083246 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.083225    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.085634 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.085614    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e7782-predictor-serving-cert\""
Jul 07 12:02:17.086018 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.086000    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-e7782-kube-rbac-proxy-sar-config\""
Jul 07 12:02:17.123368 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.123319    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:02:17.271409 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.271373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.271607 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.271427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.271607 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.271541    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdsgp\" (UniqueName: \"kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.372310 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.372273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.372487 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.372340    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdsgp\" (UniqueName: \"kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.372487 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.372393    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.372918 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.372894    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.374746 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.374694    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.391468 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.391441    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdsgp\" (UniqueName: \"kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp\") pod \"error-404-isvc-e7782-predictor-7fc45887b6-hdjss\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") " pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.393314 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.393296    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.537299 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.537271    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:02:17.539892 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:02:17.539864    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc561117_d2d9_471b_b3d4_6785af876eb3.slice/crio-4545acac853b765f5687ebb71cf1a11c31115139a786a815b44d3849cadaca43 WatchSource:0}: Error finding container 4545acac853b765f5687ebb71cf1a11c31115139a786a815b44d3849cadaca43: Status 404 returned error can't find the container with id 4545acac853b765f5687ebb71cf1a11c31115139a786a815b44d3849cadaca43
Jul 07 12:02:17.904187 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.904093    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerStarted","Data":"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"}
Jul 07 12:02:17.904187 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.904164    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.904681 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.904194    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerStarted","Data":"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"}
Jul 07 12:02:17.904681 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.904219    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerStarted","Data":"4545acac853b765f5687ebb71cf1a11c31115139a786a815b44d3849cadaca43"}
Jul 07 12:02:17.904681 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.904238    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:17.906102 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.906073    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:02:17.906102 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.906097    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerDied","Data":"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"}
Jul 07 12:02:17.906248 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:17.906079    2573 generic.go:356] "Generic (PLEG): container finished" podID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerID="4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e" exitCode=2
Jul 07 12:02:18.586700 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:18.586659    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.35:8643/healthz\": dial tcp 10.133.0.35:8643: connect: connection refused"
Jul 07 12:02:18.911151 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:18.911058    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:02:20.715862 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.715836    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:02:20.738015 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.737952    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podStartSLOduration=3.737929962 podStartE2EDuration="3.737929962s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:02:17.937614146 +0000 UTC m=+1326.267564699" watchObservedRunningTime="2026-07-07 12:02:20.737929962 +0000 UTC m=+1329.067880516"
Jul 07 12:02:20.804485 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.804404    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config\") pod \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") "
Jul 07 12:02:20.804485 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.804450    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6lpm\" (UniqueName: \"kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm\") pod \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") "
Jul 07 12:02:20.804485 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.804474    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls\") pod \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\" (UID: \"44db145b-cc4e-4b01-8185-b17ddfcdc11a\") "
Jul 07 12:02:20.804860 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.804834    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "44db145b-cc4e-4b01-8185-b17ddfcdc11a" (UID: "44db145b-cc4e-4b01-8185-b17ddfcdc11a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:02:20.806509 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.806459    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "44db145b-cc4e-4b01-8185-b17ddfcdc11a" (UID: "44db145b-cc4e-4b01-8185-b17ddfcdc11a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:02:20.806611 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.806513    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm" (OuterVolumeSpecName: "kube-api-access-s6lpm") pod "44db145b-cc4e-4b01-8185-b17ddfcdc11a" (UID: "44db145b-cc4e-4b01-8185-b17ddfcdc11a"). InnerVolumeSpecName "kube-api-access-s6lpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:02:20.905732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.905677    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:20.905732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.905724    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6lpm\" (UniqueName: \"kubernetes.io/projected/44db145b-cc4e-4b01-8185-b17ddfcdc11a-kube-api-access-s6lpm\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:20.905732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.905739    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/44db145b-cc4e-4b01-8185-b17ddfcdc11a-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:02:20.921301 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.921272    2573 generic.go:356] "Generic (PLEG): container finished" podID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerID="2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906" exitCode=0
Jul 07 12:02:20.921433 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.921330    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"
Jul 07 12:02:20.921433 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.921355    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerDied","Data":"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"}
Jul 07 12:02:20.921433 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.921423    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97" event={"ID":"44db145b-cc4e-4b01-8185-b17ddfcdc11a","Type":"ContainerDied","Data":"5e121a6c300bac69878dda360822b519059633fe0dd7a92edf93411341982a73"}
Jul 07 12:02:20.921555 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.921463    2573 scope.go:117] "RemoveContainer" containerID="4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"
Jul 07 12:02:20.930228 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.930212    2573 scope.go:117] "RemoveContainer" containerID="2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"
Jul 07 12:02:20.938634 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.938613    2573 scope.go:117] "RemoveContainer" containerID="4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"
Jul 07 12:02:20.938906 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:02:20.938884    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e\": container with ID starting with 4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e not found: ID does not exist" containerID="4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"
Jul 07 12:02:20.938980 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.938918    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e"} err="failed to get container status \"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e\": rpc error: code = NotFound desc = could not find container \"4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e\": container with ID starting with 4995c0a3efaef2fbdf8c23ff628980363c22d287cc78910f22ea44b5fb63be4e not found: ID does not exist"
Jul 07 12:02:20.938980 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.938944    2573 scope.go:117] "RemoveContainer" containerID="2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"
Jul 07 12:02:20.939216 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:02:20.939199    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906\": container with ID starting with 2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906 not found: ID does not exist" containerID="2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"
Jul 07 12:02:20.939255 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.939222    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906"} err="failed to get container status \"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906\": rpc error: code = NotFound desc = could not find container \"2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906\": container with ID starting with 2a62f33debe6d8fbdda56e6dd34642dd00733434b5e2da1dc29fb0c790ba2906 not found: ID does not exist"
Jul 07 12:02:20.945257 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.945236    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:02:20.953614 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:20.953593    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-462dc-predictor-7cbccc4d4b-dlt97"]
Jul 07 12:02:22.173867 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:22.173836    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" path="/var/lib/kubelet/pods/44db145b-cc4e-4b01-8185-b17ddfcdc11a/volumes"
Jul 07 12:02:23.916544 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:23.916517    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:02:23.917043 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:23.917016    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:02:24.824375 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:24.824333    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:02:33.917596 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:33.917506    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:02:34.823904 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:34.823857    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.36:8080: connect: connection refused"
Jul 07 12:02:43.916991 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:43.916952    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:02:44.825107 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:44.825078    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:02:53.917380 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:02:53.917336    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:03:03.918649 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:03.918622    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:03:06.657178 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657144    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:03:06.657758 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657706    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kube-rbac-proxy"
Jul 07 12:03:06.657758 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657726    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kube-rbac-proxy"
Jul 07 12:03:06.657758 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657756    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container"
Jul 07 12:03:06.657983 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657764    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container"
Jul 07 12:03:06.657983 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657867    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kube-rbac-proxy"
Jul 07 12:03:06.657983 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.657883    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44db145b-cc4e-4b01-8185-b17ddfcdc11a" containerName="kserve-container"
Jul 07 12:03:06.661312 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.661292    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.665549 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.665524    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b491e-predictor-serving-cert\""
Jul 07 12:03:06.665549 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.665549    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-b491e-kube-rbac-proxy-sar-config\""
Jul 07 12:03:06.676306 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.676283    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:03:06.705831 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.705797    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:03:06.706136 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.706081    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container" containerID="cri-o://01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f" gracePeriod=30
Jul 07 12:03:06.706292 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.706148    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kube-rbac-proxy" containerID="cri-o://bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec" gracePeriod=30
Jul 07 12:03:06.777821 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.777783    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wdd\" (UniqueName: \"kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.777821 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.777849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.778109 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.777890    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.878564 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.878529    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wdd\" (UniqueName: \"kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.878740 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.878594    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.878740 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.878615    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.879229 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.879211    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.881110 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.881085    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.886385 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.886359    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wdd\" (UniqueName: \"kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd\") pod \"error-404-isvc-b491e-predictor-7cd6c6456b-g4snd\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") " pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:06.970783 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:06.970755    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:07.099971 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:07.099944    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:03:07.102459 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:03:07.102438    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod869ea889_e085_4ce2_8d64_e6c3db17c8b1.slice/crio-bff2e0f4739cad9c28c8927014914aa39deb7e20a4becd7a1ac6841ea3340570 WatchSource:0}: Error finding container bff2e0f4739cad9c28c8927014914aa39deb7e20a4becd7a1ac6841ea3340570: Status 404 returned error can't find the container with id bff2e0f4739cad9c28c8927014914aa39deb7e20a4becd7a1ac6841ea3340570
Jul 07 12:03:07.129107 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:07.129080    2573 generic.go:356] "Generic (PLEG): container finished" podID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerID="bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec" exitCode=2
Jul 07 12:03:07.129195 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:07.129146    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerDied","Data":"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"}
Jul 07 12:03:07.130453 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:07.130433    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerStarted","Data":"bff2e0f4739cad9c28c8927014914aa39deb7e20a4becd7a1ac6841ea3340570"}
Jul 07 12:03:08.138418 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.138378    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerStarted","Data":"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"}
Jul 07 12:03:08.138881 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.138461    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:08.138881 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.138510    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerStarted","Data":"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"}
Jul 07 12:03:08.138881 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.138651    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:08.139934 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.139909    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:08.156208 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:08.156167    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podStartSLOduration=2.156153341 podStartE2EDuration="2.156153341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:03:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:03:08.154810078 +0000 UTC m=+1376.484760630" watchObservedRunningTime="2026-07-07 12:03:08.156153341 +0000 UTC m=+1376.486103966"
Jul 07 12:03:09.142549 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:09.142515    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:09.861700 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:09.861678    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:03:10.004708 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.004682    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls\") pod \"0d7be029-4076-469e-8276-1195c8f7a0e6\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") "
Jul 07 12:03:10.004904 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.004736    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqtcs\" (UniqueName: \"kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs\") pod \"0d7be029-4076-469e-8276-1195c8f7a0e6\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") "
Jul 07 12:03:10.004904 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.004771    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config\") pod \"0d7be029-4076-469e-8276-1195c8f7a0e6\" (UID: \"0d7be029-4076-469e-8276-1195c8f7a0e6\") "
Jul 07 12:03:10.005160 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.005129    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "0d7be029-4076-469e-8276-1195c8f7a0e6" (UID: "0d7be029-4076-469e-8276-1195c8f7a0e6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:03:10.006839 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.006817    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "0d7be029-4076-469e-8276-1195c8f7a0e6" (UID: "0d7be029-4076-469e-8276-1195c8f7a0e6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:03:10.006919 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.006877    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs" (OuterVolumeSpecName: "kube-api-access-bqtcs") pod "0d7be029-4076-469e-8276-1195c8f7a0e6" (UID: "0d7be029-4076-469e-8276-1195c8f7a0e6"). InnerVolumeSpecName "kube-api-access-bqtcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:03:10.105998 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.105970    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/0d7be029-4076-469e-8276-1195c8f7a0e6-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:03:10.105998 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.105997    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqtcs\" (UniqueName: \"kubernetes.io/projected/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-api-access-bqtcs\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:03:10.106188 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.106009    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/0d7be029-4076-469e-8276-1195c8f7a0e6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:03:10.148418 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.148382    2573 generic.go:356] "Generic (PLEG): container finished" podID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerID="01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f" exitCode=0
Jul 07 12:03:10.148912 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.148429    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"
Jul 07 12:03:10.148912 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.148462    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerDied","Data":"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"}
Jul 07 12:03:10.148912 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.148548    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" event={"ID":"0d7be029-4076-469e-8276-1195c8f7a0e6","Type":"ContainerDied","Data":"0b7af5087841522467818238b8d9f5db76497e0fd898ca6ec1ab7d1e35a8b84e"}
Jul 07 12:03:10.148912 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.148577    2573 scope.go:117] "RemoveContainer" containerID="bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"
Jul 07 12:03:10.157448 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.157428    2573 scope.go:117] "RemoveContainer" containerID="01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"
Jul 07 12:03:10.165439 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.165418    2573 scope.go:117] "RemoveContainer" containerID="bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"
Jul 07 12:03:10.165810 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:03:10.165790    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec\": container with ID starting with bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec not found: ID does not exist" containerID="bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"
Jul 07 12:03:10.165877 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.165821    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec"} err="failed to get container status \"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec\": rpc error: code = NotFound desc = could not find container \"bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec\": container with ID starting with bfe52c45ed6f3d07f90cc41090e94f2d1a5fb1944eba392028b6957ea5fc81ec not found: ID does not exist"
Jul 07 12:03:10.165877 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.165842    2573 scope.go:117] "RemoveContainer" containerID="01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"
Jul 07 12:03:10.166086 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:03:10.166067    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f\": container with ID starting with 01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f not found: ID does not exist" containerID="01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"
Jul 07 12:03:10.166126 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.166092    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f"} err="failed to get container status \"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f\": rpc error: code = NotFound desc = could not find container \"01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f\": container with ID starting with 01e60bc300c2e5283e2454980930b0ee934b5875574ce40cd6d8585ae68faa1f not found: ID does not exist"
Jul 07 12:03:10.177162 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.177109    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:03:10.177329 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.177178    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt"]
Jul 07 12:03:10.819331 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:10.819274    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-a4899-predictor-7c8d7697d6-w47mt" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.36:8643/healthz\": context deadline exceeded"
Jul 07 12:03:12.173779 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:12.173745    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" path="/var/lib/kubelet/pods/0d7be029-4076-469e-8276-1195c8f7a0e6/volumes"
Jul 07 12:03:14.149032 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:14.149005    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:03:14.149548 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:14.149526    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:24.149976 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:24.149939    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:34.150291 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:34.150254    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:44.150037 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:44.149996    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:03:54.151172 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:03:54.151143    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:11:31.961666 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.961631    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.961985    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kube-rbac-proxy"
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.961997    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kube-rbac-proxy"
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.962009    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container"
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.962015    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container"
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.962065    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kserve-container"
Jul 07 12:11:31.962261 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.962076    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7be029-4076-469e-8276-1195c8f7a0e6" containerName="kube-rbac-proxy"
Jul 07 12:11:31.965289 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.965270    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:31.968599 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.968580    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ec777-predictor-serving-cert\""
Jul 07 12:11:31.968906 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.968887    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-ec777-kube-rbac-proxy-sar-config\""
Jul 07 12:11:31.978812 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:31.978792    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:11:32.046272 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.046244    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:11:32.046449 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.046430    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" containerID="cri-o://770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d" gracePeriod=30
Jul 07 12:11:32.046533 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.046479    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kube-rbac-proxy" containerID="cri-o://799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79" gracePeriod=30
Jul 07 12:11:32.105994 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.105966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.106127 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.106030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrccp\" (UniqueName: \"kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.106127 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.106087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.206567 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.206534    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.206679 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.206589    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrccp\" (UniqueName: \"kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.206679 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.206625    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.206789 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:11:32.206771    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-ec777-predictor-serving-cert: secret "error-404-isvc-ec777-predictor-serving-cert" not found
Jul 07 12:11:32.206861 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:11:32.206847    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls podName:f09defa6-e8f3-402b-ab10-f92a75b448af nodeName:}" failed. No retries permitted until 2026-07-07 12:11:32.706826222 +0000 UTC m=+1881.036776768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls") pod "error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" (UID: "f09defa6-e8f3-402b-ab10-f92a75b448af") : secret "error-404-isvc-ec777-predictor-serving-cert" not found
Jul 07 12:11:32.207232 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.207212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.215405 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.215349    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrccp\" (UniqueName: \"kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.383110 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.383077    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerID="799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79" exitCode=2
Jul 07 12:11:32.383269 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.383109    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerDied","Data":"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"}
Jul 07 12:11:32.712014 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.711988    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.714315 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.714292    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") pod \"error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") " pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:32.875817 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:32.875786    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:33.006857 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.006832    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:11:33.389189 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.389104    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerStarted","Data":"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"}
Jul 07 12:11:33.389344 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.389193    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:33.389344 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.389216    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerStarted","Data":"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"}
Jul 07 12:11:33.389344 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.389235    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerStarted","Data":"8fefc76e9ecab8119b0be512d933d12ceeb4c7c74bc8fcc9ef30929013cdaf1f"}
Jul 07 12:11:33.407257 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.407211    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podStartSLOduration=2.407196876 podStartE2EDuration="2.407196876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:11:33.406045402 +0000 UTC m=+1881.735995955" watchObservedRunningTime="2026-07-07 12:11:33.407196876 +0000 UTC m=+1881.737147433"
Jul 07 12:11:33.912213 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.912119    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.37:8643/healthz\": dial tcp 10.133.0.37:8643: connect: connection refused"
Jul 07 12:11:33.917544 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:33.917514    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.37:8080: connect: connection refused"
Jul 07 12:11:34.393820 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:34.393790    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:34.395237 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:34.395207    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:11:34.890987 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:34.890966    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:11:35.031975 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.031899    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config\") pod \"cc561117-d2d9-471b-b3d4-6785af876eb3\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") "
Jul 07 12:11:35.031975 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.031933    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdsgp\" (UniqueName: \"kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp\") pod \"cc561117-d2d9-471b-b3d4-6785af876eb3\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") "
Jul 07 12:11:35.032195 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.031978    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls\") pod \"cc561117-d2d9-471b-b3d4-6785af876eb3\" (UID: \"cc561117-d2d9-471b-b3d4-6785af876eb3\") "
Jul 07 12:11:35.032319 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.032293    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "cc561117-d2d9-471b-b3d4-6785af876eb3" (UID: "cc561117-d2d9-471b-b3d4-6785af876eb3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:11:35.034055 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.034028    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cc561117-d2d9-471b-b3d4-6785af876eb3" (UID: "cc561117-d2d9-471b-b3d4-6785af876eb3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:11:35.034157 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.034056    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp" (OuterVolumeSpecName: "kube-api-access-pdsgp") pod "cc561117-d2d9-471b-b3d4-6785af876eb3" (UID: "cc561117-d2d9-471b-b3d4-6785af876eb3"). InnerVolumeSpecName "kube-api-access-pdsgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:11:35.133290 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.133254    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:11:35.133290 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.133282    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdsgp\" (UniqueName: \"kubernetes.io/projected/cc561117-d2d9-471b-b3d4-6785af876eb3-kube-api-access-pdsgp\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:11:35.133290 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.133292    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cc561117-d2d9-471b-b3d4-6785af876eb3-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:11:35.399540 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.399425    2573 generic.go:356] "Generic (PLEG): container finished" podID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerID="770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d" exitCode=0
Jul 07 12:11:35.399540 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.399471    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"
Jul 07 12:11:35.399540 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.399478    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerDied","Data":"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"}
Jul 07 12:11:35.400109 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.399570    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss" event={"ID":"cc561117-d2d9-471b-b3d4-6785af876eb3","Type":"ContainerDied","Data":"4545acac853b765f5687ebb71cf1a11c31115139a786a815b44d3849cadaca43"}
Jul 07 12:11:35.400109 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.399612    2573 scope.go:117] "RemoveContainer" containerID="799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"
Jul 07 12:11:35.400109 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.400042    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:11:35.413260 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.413244    2573 scope.go:117] "RemoveContainer" containerID="770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"
Jul 07 12:11:35.420726 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.420712    2573 scope.go:117] "RemoveContainer" containerID="799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"
Jul 07 12:11:35.420961 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:11:35.420941    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79\": container with ID starting with 799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79 not found: ID does not exist" containerID="799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"
Jul 07 12:11:35.421034 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.420972    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79"} err="failed to get container status \"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79\": rpc error: code = NotFound desc = could not find container \"799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79\": container with ID starting with 799bbee31d01d3135f128af1684a27420fe2d7be5fe816f94c58f35c2aeb6b79 not found: ID does not exist"
Jul 07 12:11:35.421034 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.420994    2573 scope.go:117] "RemoveContainer" containerID="770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"
Jul 07 12:11:35.421228 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:11:35.421210    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d\": container with ID starting with 770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d not found: ID does not exist" containerID="770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"
Jul 07 12:11:35.421277 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.421235    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d"} err="failed to get container status \"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d\": rpc error: code = NotFound desc = could not find container \"770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d\": container with ID starting with 770582a46605b2329ed297d6f7ef2d5017b1e947da66e7d6d3ec7feb2394a94d not found: ID does not exist"
Jul 07 12:11:35.429294 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.429273    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:11:35.435902 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:35.435877    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-e7782-predictor-7fc45887b6-hdjss"]
Jul 07 12:11:36.173826 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:36.173795    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" path="/var/lib/kubelet/pods/cc561117-d2d9-471b-b3d4-6785af876eb3/volumes"
Jul 07 12:11:40.404370 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:40.404346    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:11:40.404799 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:40.404776    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:11:50.404861 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:11:50.404825    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:12:00.404858 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:00.404822    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:12:10.405630 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:10.405585    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.39:8080: connect: connection refused"
Jul 07 12:12:20.405650 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:20.405618    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:12:21.455908 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.455877    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:12:21.456306 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456291    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container"
Jul 07 12:12:21.456359 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456308    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container"
Jul 07 12:12:21.456359 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456319    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kube-rbac-proxy"
Jul 07 12:12:21.456359 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456325    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kube-rbac-proxy"
Jul 07 12:12:21.456467 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456384    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kube-rbac-proxy"
Jul 07 12:12:21.456467 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.456393    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc561117-d2d9-471b-b3d4-6785af876eb3" containerName="kserve-container"
Jul 07 12:12:21.459409 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.459393    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.462147 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.462128    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-beb62-predictor-serving-cert\""
Jul 07 12:12:21.462426 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.462409    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-beb62-kube-rbac-proxy-sar-config\""
Jul 07 12:12:21.469887 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.469867    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:12:21.496279 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.496255    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.496420 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.496324    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kmbj\" (UniqueName: \"kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.496420 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.496396    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.505538 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.505512    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:12:21.505726 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.505689    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" containerID="cri-o://9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425" gracePeriod=30
Jul 07 12:12:21.505797 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.505725    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kube-rbac-proxy" containerID="cri-o://03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580" gracePeriod=30
Jul 07 12:12:21.597228 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.597192    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kmbj\" (UniqueName: \"kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.597407 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.597235    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.597407 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.597273    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.597589 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:21.597407    2573 secret.go:189] Couldn't get secret kserve-ci-e2e-test/error-404-isvc-beb62-predictor-serving-cert: secret "error-404-isvc-beb62-predictor-serving-cert" not found
Jul 07 12:12:21.597589 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:21.597464    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls podName:e9ea83f8-f245-4045-b897-fc40a0c590c3 nodeName:}" failed. No retries permitted until 2026-07-07 12:12:22.097450234 +0000 UTC m=+1930.427400766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls") pod "error-404-isvc-beb62-predictor-64dc4bbbb-759qg" (UID: "e9ea83f8-f245-4045-b897-fc40a0c590c3") : secret "error-404-isvc-beb62-predictor-serving-cert" not found
Jul 07 12:12:21.597915 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.597898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:21.613857 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:21.613828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kmbj\" (UniqueName: \"kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:22.100783 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.100748    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:22.103183 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.103164    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") pod \"error-404-isvc-beb62-predictor-64dc4bbbb-759qg\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") " pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:22.370922 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.370833    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:22.502939 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.502916    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:12:22.505182 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:12:22.505149    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ea83f8_f245_4045_b897_fc40a0c590c3.slice/crio-74cce676874c9b0dde1b545720718eda45fdaa4ca0a366e9c3ac59a9506644bb WatchSource:0}: Error finding container 74cce676874c9b0dde1b545720718eda45fdaa4ca0a366e9c3ac59a9506644bb: Status 404 returned error can't find the container with id 74cce676874c9b0dde1b545720718eda45fdaa4ca0a366e9c3ac59a9506644bb
Jul 07 12:12:22.612714 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.612688    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerStarted","Data":"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"}
Jul 07 12:12:22.612824 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.612748    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerStarted","Data":"74cce676874c9b0dde1b545720718eda45fdaa4ca0a366e9c3ac59a9506644bb"}
Jul 07 12:12:22.614229 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.614205    2573 generic.go:356] "Generic (PLEG): container finished" podID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerID="03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580" exitCode=2
Jul 07 12:12:22.614314 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:22.614251    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerDied","Data":"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"}
Jul 07 12:12:23.621063 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:23.621029    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerStarted","Data":"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"}
Jul 07 12:12:23.621477 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:23.621089    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:23.621477 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:23.621132    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:23.622766 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:23.622739    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:23.641458 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:23.641412    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podStartSLOduration=2.6413991709999998 podStartE2EDuration="2.641399171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:12:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:12:23.640140863 +0000 UTC m=+1931.970091415" watchObservedRunningTime="2026-07-07 12:12:23.641399171 +0000 UTC m=+1931.971349726"
Jul 07 12:12:24.143049 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.143012    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.38:8643/healthz\": dial tcp 10.133.0.38:8643: connect: connection refused"
Jul 07 12:12:24.150456 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.150431    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.38:8080: connect: connection refused"
Jul 07 12:12:24.445586 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.445562    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:12:24.521515 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.521466    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6wdd\" (UniqueName: \"kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd\") pod \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") "
Jul 07 12:12:24.521675 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.521529    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls\") pod \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") "
Jul 07 12:12:24.521675 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.521575    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config\") pod \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\" (UID: \"869ea889-e085-4ce2-8d64-e6c3db17c8b1\") "
Jul 07 12:12:24.521938 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.521914    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "869ea889-e085-4ce2-8d64-e6c3db17c8b1" (UID: "869ea889-e085-4ce2-8d64-e6c3db17c8b1"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:12:24.523681 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.523650    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "869ea889-e085-4ce2-8d64-e6c3db17c8b1" (UID: "869ea889-e085-4ce2-8d64-e6c3db17c8b1"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:12:24.523681 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.523667    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd" (OuterVolumeSpecName: "kube-api-access-k6wdd") pod "869ea889-e085-4ce2-8d64-e6c3db17c8b1" (UID: "869ea889-e085-4ce2-8d64-e6c3db17c8b1"). InnerVolumeSpecName "kube-api-access-k6wdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:12:24.622699 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.622673    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/869ea889-e085-4ce2-8d64-e6c3db17c8b1-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:24.622699 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.622696    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:24.623102 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.622706    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6wdd\" (UniqueName: \"kubernetes.io/projected/869ea889-e085-4ce2-8d64-e6c3db17c8b1-kube-api-access-k6wdd\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:24.626550 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.626522    2573 generic.go:356] "Generic (PLEG): container finished" podID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerID="9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425" exitCode=0
Jul 07 12:12:24.626676 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.626645    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"
Jul 07 12:12:24.626731 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.626674    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerDied","Data":"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"}
Jul 07 12:12:24.626773 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.626732    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd" event={"ID":"869ea889-e085-4ce2-8d64-e6c3db17c8b1","Type":"ContainerDied","Data":"bff2e0f4739cad9c28c8927014914aa39deb7e20a4becd7a1ac6841ea3340570"}
Jul 07 12:12:24.626773 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.626757    2573 scope.go:117] "RemoveContainer" containerID="03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"
Jul 07 12:12:24.627316 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.627284    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:24.635900 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.635879    2573 scope.go:117] "RemoveContainer" containerID="9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"
Jul 07 12:12:24.643231 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.643212    2573 scope.go:117] "RemoveContainer" containerID="03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"
Jul 07 12:12:24.643471 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:24.643454    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580\": container with ID starting with 03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580 not found: ID does not exist" containerID="03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"
Jul 07 12:12:24.643545 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.643478    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580"} err="failed to get container status \"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580\": rpc error: code = NotFound desc = could not find container \"03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580\": container with ID starting with 03dd7691aea2f861f538360a287ac3214375cbf85c9341f3242e8e8bdebe3580 not found: ID does not exist"
Jul 07 12:12:24.643545 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.643515    2573 scope.go:117] "RemoveContainer" containerID="9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"
Jul 07 12:12:24.643781 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:24.643762    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425\": container with ID starting with 9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425 not found: ID does not exist" containerID="9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"
Jul 07 12:12:24.643826 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.643786    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425"} err="failed to get container status \"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425\": rpc error: code = NotFound desc = could not find container \"9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425\": container with ID starting with 9642f22512db70b62e2950a8cb4f4dddd15b029877da7d306faa882513ac0425 not found: ID does not exist"
Jul 07 12:12:24.649560 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.649534    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:12:24.657203 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:24.657184    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-b491e-predictor-7cd6c6456b-g4snd"]
Jul 07 12:12:26.174719 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:26.174687    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" path="/var/lib/kubelet/pods/869ea889-e085-4ce2-8d64-e6c3db17c8b1/volumes"
Jul 07 12:12:29.632046 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:29.632018    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:12:29.632551 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:29.632435    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:39.632440 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:39.632398    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:42.175609 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.175571    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:12:42.176018 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.175940    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kube-rbac-proxy"
Jul 07 12:12:42.176018 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.175952    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kube-rbac-proxy"
Jul 07 12:12:42.176018 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.175970    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container"
Jul 07 12:12:42.176018 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.175976    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container"
Jul 07 12:12:42.176149 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.176025    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kube-rbac-proxy"
Jul 07 12:12:42.176149 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.176034    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="869ea889-e085-4ce2-8d64-e6c3db17c8b1" containerName="kserve-container"
Jul 07 12:12:42.180691 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.180674    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.183528 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.183508    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5d4cc-predictor-serving-cert\""
Jul 07 12:12:42.184147 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.184128    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"error-404-isvc-5d4cc-kube-rbac-proxy-sar-config\""
Jul 07 12:12:42.192576 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.192555    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:12:42.240091 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.240058    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:12:42.240299 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.240275    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container" containerID="cri-o://d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3" gracePeriod=30
Jul 07 12:12:42.240352 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.240302    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kube-rbac-proxy" containerID="cri-o://f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1" gracePeriod=30
Jul 07 12:12:42.278597 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.278563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrqx5\" (UniqueName: \"kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.278740 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.278701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.278815 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.278740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.379673 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.379634    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrqx5\" (UniqueName: \"kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.379836 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.379679    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.379836 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.379710    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.380315 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.380287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.381996 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.381975    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.388379 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.388356    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrqx5\" (UniqueName: \"kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5\") pod \"error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") " pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.490328 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.490295    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:42.631581 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.629548    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:12:42.634287 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:12:42.634256    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad5c9d7_ada1_4aa3_a024_1f78eafed6e0.slice/crio-4ce46bd057ad991977eda88527be01326ff09297ecaefb27f3f1106043adc8bd WatchSource:0}: Error finding container 4ce46bd057ad991977eda88527be01326ff09297ecaefb27f3f1106043adc8bd: Status 404 returned error can't find the container with id 4ce46bd057ad991977eda88527be01326ff09297ecaefb27f3f1106043adc8bd
Jul 07 12:12:42.712234 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.712211    2573 generic.go:356] "Generic (PLEG): container finished" podID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerID="f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1" exitCode=2
Jul 07 12:12:42.712338 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.712288    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerDied","Data":"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"}
Jul 07 12:12:42.713641 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.713607    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerStarted","Data":"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"}
Jul 07 12:12:42.713722 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:42.713663    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerStarted","Data":"4ce46bd057ad991977eda88527be01326ff09297ecaefb27f3f1106043adc8bd"}
Jul 07 12:12:43.719900 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:43.719863    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerStarted","Data":"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"}
Jul 07 12:12:43.720341 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:43.720025    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:43.720341 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:43.720069    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:43.721276 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:43.721252    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:12:43.743252 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:43.743202    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podStartSLOduration=1.743187716 podStartE2EDuration="1.743187716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 12:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:12:43.74109523 +0000 UTC m=+1952.071045783" watchObservedRunningTime="2026-07-07 12:12:43.743187716 +0000 UTC m=+1952.073138269"
Jul 07 12:12:44.726019 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:44.725976    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:12:45.401288 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.401249    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.39:8643/healthz\": dial tcp 10.133.0.39:8643: connect: connection refused"
Jul 07 12:12:45.685968 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.685943    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:12:45.732042 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.732005    2573 generic.go:356] "Generic (PLEG): container finished" podID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerID="d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3" exitCode=0
Jul 07 12:12:45.732530 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.732064    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"
Jul 07 12:12:45.732530 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.732148    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerDied","Data":"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"}
Jul 07 12:12:45.732530 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.732198    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt" event={"ID":"f09defa6-e8f3-402b-ab10-f92a75b448af","Type":"ContainerDied","Data":"8fefc76e9ecab8119b0be512d933d12ceeb4c7c74bc8fcc9ef30929013cdaf1f"}
Jul 07 12:12:45.732530 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.732230    2573 scope.go:117] "RemoveContainer" containerID="f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"
Jul 07 12:12:45.741291 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.741268    2573 scope.go:117] "RemoveContainer" containerID="d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"
Jul 07 12:12:45.748218 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.748200    2573 scope.go:117] "RemoveContainer" containerID="f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"
Jul 07 12:12:45.748481 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:45.748463    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1\": container with ID starting with f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1 not found: ID does not exist" containerID="f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"
Jul 07 12:12:45.748564 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.748507    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1"} err="failed to get container status \"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1\": rpc error: code = NotFound desc = could not find container \"f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1\": container with ID starting with f37ce3aff1a7b949511c4a6724fa635f7fd93c3850f3eef436777af43d5389e1 not found: ID does not exist"
Jul 07 12:12:45.748564 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.748532    2573 scope.go:117] "RemoveContainer" containerID="d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"
Jul 07 12:12:45.748804 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:12:45.748789    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3\": container with ID starting with d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3 not found: ID does not exist" containerID="d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"
Jul 07 12:12:45.748871 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.748808    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3"} err="failed to get container status \"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3\": rpc error: code = NotFound desc = could not find container \"d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3\": container with ID starting with d1ffa302d4c27ee6a7f18725ca29491544a06853a957a341f27ba9fe7c90ddb3 not found: ID does not exist"
Jul 07 12:12:45.809126 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.809102    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrccp\" (UniqueName: \"kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp\") pod \"f09defa6-e8f3-402b-ab10-f92a75b448af\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") "
Jul 07 12:12:45.809246 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.809190    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config\") pod \"f09defa6-e8f3-402b-ab10-f92a75b448af\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") "
Jul 07 12:12:45.809246 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.809231    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") pod \"f09defa6-e8f3-402b-ab10-f92a75b448af\" (UID: \"f09defa6-e8f3-402b-ab10-f92a75b448af\") "
Jul 07 12:12:45.809591 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.809558    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f09defa6-e8f3-402b-ab10-f92a75b448af" (UID: "f09defa6-e8f3-402b-ab10-f92a75b448af"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:12:45.811097 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.811074    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp" (OuterVolumeSpecName: "kube-api-access-lrccp") pod "f09defa6-e8f3-402b-ab10-f92a75b448af" (UID: "f09defa6-e8f3-402b-ab10-f92a75b448af"). InnerVolumeSpecName "kube-api-access-lrccp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:12:45.811285 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.811179    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f09defa6-e8f3-402b-ab10-f92a75b448af" (UID: "f09defa6-e8f3-402b-ab10-f92a75b448af"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:12:45.910049 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.909980    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrccp\" (UniqueName: \"kubernetes.io/projected/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-api-access-lrccp\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:45.910049 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.910005    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f09defa6-e8f3-402b-ab10-f92a75b448af-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:45.910049 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:45.910015    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f09defa6-e8f3-402b-ab10-f92a75b448af-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:12:46.055902 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:46.055874    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:12:46.058126 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:46.058101    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-ec777-predictor-6b58bbd7b6-cb5wt"]
Jul 07 12:12:46.173666 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:46.173589    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" path="/var/lib/kubelet/pods/f09defa6-e8f3-402b-ab10-f92a75b448af/volumes"
Jul 07 12:12:49.632476 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:49.632430    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:49.730177 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:49.730148    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:12:49.730752 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:49.730723    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:12:59.632514 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:59.632455    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.40:8080: connect: connection refused"
Jul 07 12:12:59.731181 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:12:59.731134    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:13:09.633115 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:13:09.633023    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:13:09.731080 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:13:09.731046    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:13:19.731044 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:13:19.731005    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:13:29.732191 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:13:29.732156    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:21:56.876716 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:56.876681    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:21:56.879384 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:56.877605    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kube-rbac-proxy" containerID="cri-o://c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6" gracePeriod=30
Jul 07 12:21:56.879384 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:56.877481    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" containerID="cri-o://0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e" gracePeriod=30
Jul 07 12:21:57.180240 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:57.180149    2573 generic.go:356] "Generic (PLEG): container finished" podID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerID="c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6" exitCode=2
Jul 07 12:21:57.180240 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:57.180220    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerDied","Data":"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"}
Jul 07 12:21:59.726839 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:59.726799    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.41:8643/healthz\": dial tcp 10.133.0.41:8643: connect: connection refused"
Jul 07 12:21:59.731518 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:21:59.731477    2573 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.41:8080: connect: connection refused"
Jul 07 12:22:00.035123 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.035100    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:22:00.133106 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.133073    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrqx5\" (UniqueName: \"kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5\") pod \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") "
Jul 07 12:22:00.133302 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.133118    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls\") pod \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") "
Jul 07 12:22:00.133302 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.133145    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config\") pod \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\" (UID: \"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0\") "
Jul 07 12:22:00.133535 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.133488    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" (UID: "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:22:00.135179 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.135159    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" (UID: "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:22:00.135274 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.135250    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5" (OuterVolumeSpecName: "kube-api-access-vrqx5") pod "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" (UID: "bad5c9d7-ada1-4aa3-a024-1f78eafed6e0"). InnerVolumeSpecName "kube-api-access-vrqx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:22:00.194088 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.194057    2573 generic.go:356] "Generic (PLEG): container finished" podID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerID="0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e" exitCode=0
Jul 07 12:22:00.194210 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.194102    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"
Jul 07 12:22:00.194210 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.194107    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerDied","Data":"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"}
Jul 07 12:22:00.194210 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.194164    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw" event={"ID":"bad5c9d7-ada1-4aa3-a024-1f78eafed6e0","Type":"ContainerDied","Data":"4ce46bd057ad991977eda88527be01326ff09297ecaefb27f3f1106043adc8bd"}
Jul 07 12:22:00.194210 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.194191    2573 scope.go:117] "RemoveContainer" containerID="c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"
Jul 07 12:22:00.202598 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.202581    2573 scope.go:117] "RemoveContainer" containerID="0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"
Jul 07 12:22:00.209537 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.209515    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:22:00.209965 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.209949    2573 scope.go:117] "RemoveContainer" containerID="c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"
Jul 07 12:22:00.210246 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:22:00.210226    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6\": container with ID starting with c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6 not found: ID does not exist" containerID="c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"
Jul 07 12:22:00.210300 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.210257    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6"} err="failed to get container status \"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6\": rpc error: code = NotFound desc = could not find container \"c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6\": container with ID starting with c3376fdbd11013976bd4655497eb432c598939a14679b994b3076f53277287a6 not found: ID does not exist"
Jul 07 12:22:00.210300 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.210275    2573 scope.go:117] "RemoveContainer" containerID="0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"
Jul 07 12:22:00.210549 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:22:00.210533    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e\": container with ID starting with 0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e not found: ID does not exist" containerID="0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"
Jul 07 12:22:00.210594 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.210555    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e"} err="failed to get container status \"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e\": rpc error: code = NotFound desc = could not find container \"0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e\": container with ID starting with 0d09ba11f8b4d45a476a030a697db06cbbf93a74eb9afbb7c3b447b470deea7e not found: ID does not exist"
Jul 07 12:22:00.214978 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.214958    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-5d4cc-predictor-59b9c7746b-g2bjw"]
Jul 07 12:22:00.234700 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.234678    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrqx5\" (UniqueName: \"kubernetes.io/projected/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-api-access-vrqx5\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:22:00.234700 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.234698    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:22:00.234801 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:00.234708    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:22:02.173682 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:22:02.173650    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" path="/var/lib/kubelet/pods/bad5c9d7-ada1-4aa3-a024-1f78eafed6e0/volumes"
Jul 07 12:29:40.889264 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:40.889234    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:29:40.891701 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:40.889463    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container" containerID="cri-o://9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d" gracePeriod=30
Jul 07 12:29:40.891701 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:40.889531    2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kube-rbac-proxy" containerID="cri-o://72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0" gracePeriod=30
Jul 07 12:29:41.222617 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:41.222586    2573 generic.go:356] "Generic (PLEG): container finished" podID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerID="72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0" exitCode=2
Jul 07 12:29:41.222784 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:41.222662    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerDied","Data":"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"}
Jul 07 12:29:43.634447 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.634423    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:29:43.720002 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.719942    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") pod \"e9ea83f8-f245-4045-b897-fc40a0c590c3\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") "
Jul 07 12:29:43.720112 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.720017    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kmbj\" (UniqueName: \"kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj\") pod \"e9ea83f8-f245-4045-b897-fc40a0c590c3\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") "
Jul 07 12:29:43.720112 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.720039    2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config\") pod \"e9ea83f8-f245-4045-b897-fc40a0c590c3\" (UID: \"e9ea83f8-f245-4045-b897-fc40a0c590c3\") "
Jul 07 12:29:43.720432 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.720407    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e9ea83f8-f245-4045-b897-fc40a0c590c3" (UID: "e9ea83f8-f245-4045-b897-fc40a0c590c3"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 12:29:43.721809 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.721791    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e9ea83f8-f245-4045-b897-fc40a0c590c3" (UID: "e9ea83f8-f245-4045-b897-fc40a0c590c3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 12:29:43.721989 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.721967    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj" (OuterVolumeSpecName: "kube-api-access-4kmbj") pod "e9ea83f8-f245-4045-b897-fc40a0c590c3" (UID: "e9ea83f8-f245-4045-b897-fc40a0c590c3"). InnerVolumeSpecName "kube-api-access-4kmbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 12:29:43.820639 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.820603    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kmbj\" (UniqueName: \"kubernetes.io/projected/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-api-access-4kmbj\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:29:43.820639 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.820636    2573 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e9ea83f8-f245-4045-b897-fc40a0c590c3-kube-rbac-proxy-sar-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:29:43.820639 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:43.820646    2573 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e9ea83f8-f245-4045-b897-fc40a0c590c3-proxy-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\""
Jul 07 12:29:44.236478 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.236448    2573 generic.go:356] "Generic (PLEG): container finished" podID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerID="9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d" exitCode=0
Jul 07 12:29:44.236623 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.236526    2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"
Jul 07 12:29:44.236623 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.236529    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerDied","Data":"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"}
Jul 07 12:29:44.236742 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.236647    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg" event={"ID":"e9ea83f8-f245-4045-b897-fc40a0c590c3","Type":"ContainerDied","Data":"74cce676874c9b0dde1b545720718eda45fdaa4ca0a366e9c3ac59a9506644bb"}
Jul 07 12:29:44.236742 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.236673    2573 scope.go:117] "RemoveContainer" containerID="72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"
Jul 07 12:29:44.244699 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.244680    2573 scope.go:117] "RemoveContainer" containerID="9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"
Jul 07 12:29:44.251634 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.251587    2573 scope.go:117] "RemoveContainer" containerID="72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"
Jul 07 12:29:44.251854 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:29:44.251830    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0\": container with ID starting with 72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0 not found: ID does not exist" containerID="72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"
Jul 07 12:29:44.252000 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.251870    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0"} err="failed to get container status \"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0\": rpc error: code = NotFound desc = could not find container \"72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0\": container with ID starting with 72c09566c3bf85cf7ed81cd5a7a971c87cb21aba177fadd2d3e2d2ee692329a0 not found: ID does not exist"
Jul 07 12:29:44.252000 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.251894    2573 scope.go:117] "RemoveContainer" containerID="9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"
Jul 07 12:29:44.252244 ip-10-0-138-101 kubenswrapper[2573]: E0707 12:29:44.252185    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d\": container with ID starting with 9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d not found: ID does not exist" containerID="9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"
Jul 07 12:29:44.252244 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.252215    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d"} err="failed to get container status \"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d\": rpc error: code = NotFound desc = could not find container \"9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d\": container with ID starting with 9007604d18c7c3b86b9b6f41365716250fc739fff029ab4ba36197fbf0cde83d not found: ID does not exist"
Jul 07 12:29:44.253989 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.253972    2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:29:44.258081 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:44.258059    2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/error-404-isvc-beb62-predictor-64dc4bbbb-759qg"]
Jul 07 12:29:46.176019 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:29:46.175979    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" path="/var/lib/kubelet/pods/e9ea83f8-f245-4045-b897-fc40a0c590c3/volumes"
Jul 07 12:30:14.302943 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:14.302913    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-267gf_c8f39cb0-9ed5-407f-bc24-4d5a50629eb8/global-pull-secret-syncer/0.log"
Jul 07 12:30:14.542973 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:14.542943    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6wnc9_49fed9bb-29e8-463a-b26f-d553bb99ca32/konnectivity-agent/0.log"
Jul 07 12:30:14.630217 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:14.630155    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-101.ec2.internal_9b6c8b6d42e5b52ab4cf9f706a9be0f7/haproxy/0.log"
Jul 07 12:30:18.963671 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:18.963635    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/alertmanager/0.log"
Jul 07 12:30:18.988759 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:18.988734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/config-reloader/0.log"
Jul 07 12:30:19.021826 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.021802    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/kube-rbac-proxy-web/0.log"
Jul 07 12:30:19.052595 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.052578    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/kube-rbac-proxy/0.log"
Jul 07 12:30:19.080364 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.080344    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/kube-rbac-proxy-metric/0.log"
Jul 07 12:30:19.107716 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.107689    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/prom-label-proxy/0.log"
Jul 07 12:30:19.136485 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.136467    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ab96511-7a6d-48b4-9d53-6c0cbb276138/init-config-reloader/0.log"
Jul 07 12:30:19.287011 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.286933    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b8d89f6c9-gtcwj_2ec3c53c-3007-4ae9-a9ee-084fb736f422/metrics-server/0.log"
Jul 07 12:30:19.350701 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.350678    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56rq4_7b591266-515e-4f31-9fd5-de472f627373/node-exporter/0.log"
Jul 07 12:30:19.376272 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.376235    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56rq4_7b591266-515e-4f31-9fd5-de472f627373/kube-rbac-proxy/0.log"
Jul 07 12:30:19.410807 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.410790    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-56rq4_7b591266-515e-4f31-9fd5-de472f627373/init-textfile/0.log"
Jul 07 12:30:19.607686 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.607590    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qjk8w_f3356462-ae5a-4ed3-818d-871a26d335f7/kube-rbac-proxy-main/0.log"
Jul 07 12:30:19.634808 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.634783    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qjk8w_f3356462-ae5a-4ed3-818d-871a26d335f7/kube-rbac-proxy-self/0.log"
Jul 07 12:30:19.658857 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.658834    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-qjk8w_f3356462-ae5a-4ed3-818d-871a26d335f7/openshift-state-metrics/0.log"
Jul 07 12:30:19.938979 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.938958    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-d5t76_55f4f97d-52ff-47f3-8643-e193d8856aa2/prometheus-operator-admission-webhook/0.log"
Jul 07 12:30:19.978617 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:19.978597    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564fdf9475-d9wmp_5c7cb524-cdbb-4e68-b8c8-b0d774a109d1/telemeter-client/0.log"
Jul 07 12:30:20.013772 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:20.013751    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564fdf9475-d9wmp_5c7cb524-cdbb-4e68-b8c8-b0d774a109d1/reload/0.log"
Jul 07 12:30:20.050377 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:20.050354    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-564fdf9475-d9wmp_5c7cb524-cdbb-4e68-b8c8-b0d774a109d1/kube-rbac-proxy/0.log"
Jul 07 12:30:22.252377 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.252349    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7c447f467-tnspb_3f6f97c0-5956-4942-8234-e5daf37d823d/console/0.log"
Jul 07 12:30:22.283175 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.283150    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-rr8mk_19f6f7c2-351a-42a0-b30f-0e603ca7c7e7/download-server/0.log"
Jul 07 12:30:22.382126 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382094    2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"]
Jul 07 12:30:22.382442 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382429    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382444    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382459    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382465    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382477    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382483    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382505    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382508 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382511    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382519    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382524    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382534    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382539    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382592    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kserve-container"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382600    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kserve-container"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382606    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kserve-container"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382613    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="f09defa6-e8f3-402b-ab10-f92a75b448af" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382619    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ea83f8-f245-4045-b897-fc40a0c590c3" containerName="kube-rbac-proxy"
Jul 07 12:30:22.382732 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.382624    2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bad5c9d7-ada1-4aa3-a024-1f78eafed6e0" containerName="kube-rbac-proxy"
Jul 07 12:30:22.386630 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.386612    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.389277 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.389259    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-56zxf\"/\"openshift-service-ca.crt\""
Jul 07 12:30:22.389385 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.389278    2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-56zxf\"/\"kube-root-ca.crt\""
Jul 07 12:30:22.390003 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.389990    2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-56zxf\"/\"default-dockercfg-nl56f\""
Jul 07 12:30:22.396851 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.396829    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"]
Jul 07 12:30:22.524565 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.524467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-lib-modules\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.524565 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.524525    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-podres\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.524761 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.524567    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-proc\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.524761 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.524597    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhcdm\" (UniqueName: \"kubernetes.io/projected/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-kube-api-access-rhcdm\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.524761 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.524707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-sys\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.625842 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625804    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-sys\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625857    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-lib-modules\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625878    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-podres\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625901    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-proc\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625929    2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhcdm\" (UniqueName: \"kubernetes.io/projected/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-kube-api-access-rhcdm\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.625932    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-sys\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626020 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.626002    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-proc\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626272 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.626033    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-lib-modules\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.626272 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.626052    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-podres\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.633367 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.633343    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhcdm\" (UniqueName: \"kubernetes.io/projected/b120b8d7-f3ed-4a56-aaf7-aaa955705f61-kube-api-access-rhcdm\") pod \"perf-node-gather-daemonset-clrss\" (UID: \"b120b8d7-f3ed-4a56-aaf7-aaa955705f61\") " pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.696932 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.696909    2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:22.834229 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:22.834201    2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"]
Jul 07 12:30:22.835797 ip-10-0-138-101 kubenswrapper[2573]: W0707 12:30:22.835767    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb120b8d7_f3ed_4a56_aaf7_aaa955705f61.slice/crio-6b3e588668de9a903e8ef4d383cdaa39f27044ce63a5876eb0923ebd17184501 WatchSource:0}: Error finding container 6b3e588668de9a903e8ef4d383cdaa39f27044ce63a5876eb0923ebd17184501: Status 404 returned error can't find the container with id 6b3e588668de9a903e8ef4d383cdaa39f27044ce63a5876eb0923ebd17184501
Jul 07 12:30:23.413804 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.413766    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss" event={"ID":"b120b8d7-f3ed-4a56-aaf7-aaa955705f61","Type":"ContainerStarted","Data":"8326b06e8648ab8c1a85f5e0381cd11f404551924e77b7fb9e11cdf114afad15"}
Jul 07 12:30:23.414194 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.413829    2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss" event={"ID":"b120b8d7-f3ed-4a56-aaf7-aaa955705f61","Type":"ContainerStarted","Data":"6b3e588668de9a903e8ef4d383cdaa39f27044ce63a5876eb0923ebd17184501"}
Jul 07 12:30:23.414194 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.413907    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:23.430426 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.430384    2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss" podStartSLOduration=1.430371417 podStartE2EDuration="1.430371417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 12:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 12:30:23.428962514 +0000 UTC m=+3011.758913067" watchObservedRunningTime="2026-07-07 12:30:23.430371417 +0000 UTC m=+3011.760321971"
Jul 07 12:30:23.732244 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.732190    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8b77h_1cea6405-788c-4407-a788-1e71b21add88/dns/0.log"
Jul 07 12:30:23.755902 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.755884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8b77h_1cea6405-788c-4407-a788-1e71b21add88/kube-rbac-proxy/0.log"
Jul 07 12:30:23.836745 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:23.836716    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-647j8_2f00339e-0287-49c1-918e-3ae7eefc63f5/dns-node-resolver/0.log"
Jul 07 12:30:24.425906 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:24.425879    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7fdf547d95-6t4wn_cd8facfc-8366-46be-aa6d-79db712519f5/registry/0.log"
Jul 07 12:30:24.446802 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:24.446777    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9js97_130eef1e-7d34-44d6-9a77-f0505f0fdc34/node-ca/0.log"
Jul 07 12:30:25.608052 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:25.608019    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-84pw6_d3880cb2-fbd5-43d6-ad51-af927bd3c4f1/serve-healthcheck-canary/0.log"
Jul 07 12:30:26.168884 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:26.168859    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt447_b832c7bf-5efe-494c-a09f-3ad8d444b52b/kube-rbac-proxy/0.log"
Jul 07 12:30:26.188583 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:26.188556    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt447_b832c7bf-5efe-494c-a09f-3ad8d444b52b/exporter/0.log"
Jul 07 12:30:26.209315 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:26.209294    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xt447_b832c7bf-5efe-494c-a09f-3ad8d444b52b/extractor/0.log"
Jul 07 12:30:28.188924 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:28.188854    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-57676b4bd8-54mlr_4e0d3272-fbd0-476c-963b-fd0e0cd163fe/manager/0.log"
Jul 07 12:30:28.208697 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:28.208675    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-zd7s5_1c5dd3cd-1690-4ad9-9a68-df4d84cc3406/manager/0.log"
Jul 07 12:30:28.232547 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:28.232528    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-9zshz_e8830845-dd8f-45ca-811e-0f9118437880/server/0.log"
Jul 07 12:30:28.500184 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:28.500106    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-9nlxz_f3827668-3227-46cc-b9f3-254fd5dfd0e4/seaweedfs/0.log"
Jul 07 12:30:29.426696 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:29.426668    2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-56zxf/perf-node-gather-daemonset-clrss"
Jul 07 12:30:34.012118 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.012092    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/kube-multus-additional-cni-plugins/0.log"
Jul 07 12:30:34.040170 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.040146    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/egress-router-binary-copy/0.log"
Jul 07 12:30:34.061841 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.061814    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/cni-plugins/0.log"
Jul 07 12:30:34.084279 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.084207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/bond-cni-plugin/0.log"
Jul 07 12:30:34.110033 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.110007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/routeoverride-cni/0.log"
Jul 07 12:30:34.131363 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.131346    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/whereabouts-cni-bincopy/0.log"
Jul 07 12:30:34.152612 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.152587    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lnm76_33aa2fa4-4b97-4472-96e5-571d63404a9f/whereabouts-cni/0.log"
Jul 07 12:30:34.384381 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.384311    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jz5ms_ab882f1c-db28-4459-8f41-4ff9b2fa7589/kube-multus/0.log"
Jul 07 12:30:34.448586 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.448564    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bfc7d_f7270841-92d4-4c62-b476-17a56cbf4670/network-metrics-daemon/0.log"
Jul 07 12:30:34.467675 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:34.467649    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bfc7d_f7270841-92d4-4c62-b476-17a56cbf4670/kube-rbac-proxy/0.log"
Jul 07 12:30:35.430837 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.430787    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/ovn-controller/0.log"
Jul 07 12:30:35.450426 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.450406    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/ovn-acl-logging/0.log"
Jul 07 12:30:35.473314 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.473287    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/kube-rbac-proxy-node/0.log"
Jul 07 12:30:35.494287 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.494267    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/kube-rbac-proxy-ovn-metrics/0.log"
Jul 07 12:30:35.514975 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.514956    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/northd/0.log"
Jul 07 12:30:35.535562 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.535525    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/nbdb/0.log"
Jul 07 12:30:35.555540 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.555516    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/sbdb/0.log"
Jul 07 12:30:35.594932 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:35.594907    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cfhw6_3ad64b64-38ac-450a-b1ab-8dbd303c5f73/ovnkube-controller/0.log"
Jul 07 12:30:36.904339 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:36.904314    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-f2vwq_e8447192-4f91-4dcb-be7d-00eb51811bcd/network-check-target-container/0.log"
Jul 07 12:30:37.835941 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:37.835915    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xmn2m_2ee3855f-0211-4dbf-b404-0e381b9a8a81/iptables-alerter/0.log"
Jul 07 12:30:38.518743 ip-10-0-138-101 kubenswrapper[2573]: I0707 12:30:38.518712    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-st8fr_7de6eedd-06d6-4109-8725-8bed24e73f85/tuned/0.log"