Jul 17 10:00:41.397532 ip-10-0-128-133 systemd[1]: Starting Kubernetes Kubelet... Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.709586 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803859 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803877 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803883 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803887 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803892 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803897 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803902 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.804072 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803906 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803910 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803913 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803920 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803926 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803931 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803934 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803939 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803944 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803948 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803952 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803956 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803960 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803968 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803974 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803979 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803983 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803987 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803991 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803995 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.808371 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.803999 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804004 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804008 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804012 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804016 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804023 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804028 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804032 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804035 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804038 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804040 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804047 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804050 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804052 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804055 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804059 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804062 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804065 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804068 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804070 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.808931 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804073 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804076 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804078 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804081 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804084 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804087 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804089 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804092 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804094 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804097 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804100 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804103 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804105 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804108 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804111 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804113 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804116 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804118 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804121 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804123 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.809811 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804126 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804129 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804131 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804134 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804137 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804140 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804142 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804144 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804147 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804149 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804152 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804175 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804181 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804184 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804187 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804190 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804193 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804196 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804199 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.814677 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804203 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804207 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804210 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804227 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804230 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804233 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804235 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804238 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804240 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804243 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804245 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804248 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.804250 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805599 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805611 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805615 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805619 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805624 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805631 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805635 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.816271 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805640 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805645 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805649 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805655 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805660 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805663 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805667 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805671 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805675 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805679 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805685 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805691 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805695 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805699 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805704 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805709 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805713 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805717 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805721 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805724 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.834356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805728 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805733 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805736 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805740 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805744 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805747 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805751 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805755 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805758 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805762 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805767 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805773 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805776 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805780 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805783 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805789 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805793 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805797 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805800 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805804 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.835152 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805809 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805813 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805817 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805821 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805824 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805829 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805832 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805836 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805840 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805844 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805848 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805852 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805855 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805859 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805863 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805869 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805872 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805876 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805880 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.835965 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805886 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805891 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805896 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805899 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805903 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805908 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805912 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805916 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805922 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805928 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805933 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805938 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805942 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805946 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805950 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805955 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805958 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805962 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805966 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.836766 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805970 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805974 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805978 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805982 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805985 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805989 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805993 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.805997 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806001 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806006 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806010 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806013 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806017 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806021 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806604 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806612 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806617 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806622 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806626 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806630 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.837574 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806634 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806641 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806645 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806649 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806653 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806657 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806661 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806665 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806669 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806673 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806677 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806680 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806684 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806687 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806691 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806695 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806699 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806703 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806706 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806710 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.838387 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806714 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806720 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806724 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806728 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806732 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806735 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806739 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806743 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806747 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806751 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806754 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806759 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806763 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806767 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806771 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806775 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806779 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806782 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806788 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806793 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.839186 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806798 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806802 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806806 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806811 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806815 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806820 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806825 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806831 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806835 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806839 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806843 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806847 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806851 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806859 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806864 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806868 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806872 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806877 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806881 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.839986 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806885 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806890 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806894 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806898 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806901 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806907 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806913 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806917 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806921 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806925 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806929 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806932 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806937 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806941 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806945 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806949 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806952 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806956 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806960 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806964 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.840794 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806967 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806971 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806975 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806978 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806982 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806985 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806992 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.806996 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807000 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807004 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807008 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807012 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807015 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.807019 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807107 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807118 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807128 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807134 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807142 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807147 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807153 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 10:00:41.841603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807159 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807164 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807169 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807174 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807179 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807184 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807189 2562 flags.go:64] FLAG: --cgroup-root="" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807193 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807197 2562 flags.go:64] FLAG: --client-ca-file="" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807201 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807205 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807212 2562 flags.go:64] FLAG: --cluster-domain="" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807246 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807251 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807255 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807260 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807267 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807271 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807278 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807283 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807287 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807292 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807296 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807300 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 10:00:41.842430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807305 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807311 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807316 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807320 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807324 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807331 2562 flags.go:64] FLAG: --enable-server="true" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807337 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807344 2562 flags.go:64] FLAG: --event-burst="100" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807349 2562 flags.go:64] FLAG: --event-qps="50" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807354 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807359 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807363 2562 flags.go:64] FLAG: --eviction-hard="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807383 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807388 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807392 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807396 2562 flags.go:64] FLAG: --eviction-soft="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807400 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807405 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807409 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807414 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807418 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807422 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807426 2562 flags.go:64] FLAG: --feature-gates="" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807432 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807437 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 10:00:41.843235 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807442 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807448 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807452 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807457 2562 flags.go:64] FLAG: --help="false" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807461 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-133.ec2.internal" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807466 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807470 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807476 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807481 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807486 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807491 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807495 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807502 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807506 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807511 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807516 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807521 2562 flags.go:64] FLAG: --kube-reserved="" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807525 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807529 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807534 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807538 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807543 2562 flags.go:64] FLAG: --lock-file="" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807547 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807551 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 10:00:41.844034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807556 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807564 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807569 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807573 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807577 2562 flags.go:64] FLAG: --logging-format="text" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807582 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807587 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807591 2562 flags.go:64] FLAG: --manifest-url="" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807595 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807603 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807607 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807614 2562 flags.go:64] FLAG: --max-pods="110" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807618 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807623 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807627 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807631 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807636 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807640 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807644 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807655 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807661 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807666 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807671 2562 flags.go:64] FLAG: --pod-cidr="" Jul 17 10:00:41.844841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807675 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807683 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807688 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807692 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807697 2562 flags.go:64] FLAG: --port="10250" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807702 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807705 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-028e79841647d1679" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807710 2562 flags.go:64] FLAG: --qos-reserved="" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807714 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807719 2562 flags.go:64] FLAG: --register-node="true" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807723 2562 flags.go:64] FLAG: --register-with-taints="" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807729 2562 flags.go:64] FLAG: --registry-burst="10" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807733 2562 flags.go:64] FLAG: --registry-qps="5" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807737 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807741 2562 flags.go:64] FLAG: --reserved-memory="" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807747 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807751 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807756 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807761 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807766 2562 flags.go:64] FLAG: --runonce="false" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807771 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807775 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807780 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807785 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807789 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807793 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 10:00:41.845653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807797 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807802 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807806 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807811 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807817 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807821 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807826 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807831 2562 flags.go:64] FLAG: --system-cgroups="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807836 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807843 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807848 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807852 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807858 2562 flags.go:64] FLAG: --tls-min-version="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807861 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807865 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807870 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807874 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807879 2562 flags.go:64] FLAG: --v="2" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807884 2562 flags.go:64] FLAG: --version="false" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807890 2562 flags.go:64] FLAG: --vmodule="" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807895 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.807900 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808066 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808072 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.846455 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808078 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808084 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808088 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808092 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808096 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808101 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808105 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808109 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808112 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808116 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808120 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808124 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808129 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808133 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808137 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808141 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808146 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808150 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808154 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808159 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.847270 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808163 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808166 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808170 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808174 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808178 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808182 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808185 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808189 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808192 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808196 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808200 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808204 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808210 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808229 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808234 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808238 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808242 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808246 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808249 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808253 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.848066 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808257 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808261 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808265 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808269 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808276 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808280 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808284 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808288 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808292 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808300 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808304 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808308 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808312 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808316 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808320 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808324 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808328 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808332 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808336 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808339 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.848873 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808344 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808348 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808352 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808356 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808360 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808363 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808366 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808369 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808372 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808375 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808377 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808380 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808383 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808385 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808388 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808391 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808394 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808397 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808399 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808402 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.849678 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808405 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808407 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808411 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808414 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808417 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808419 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808422 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808426 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808429 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808432 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808436 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808439 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808442 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808445 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808449 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808452 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.950523 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.808456 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.808941 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.817275 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.817290 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.817313 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.817321 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817395 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817402 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817407 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817411 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817416 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817420 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817424 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817429 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817433 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.951321 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817438 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817443 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817447 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817453 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817457 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817461 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817466 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817471 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817475 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817479 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817483 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817487 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817491 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817494 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817498 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817502 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817506 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817510 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817514 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.961793 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817517 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817521 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817525 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817528 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817532 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817536 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817540 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817544 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817547 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817551 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817554 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817561 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817567 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817571 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817575 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817579 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817583 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817587 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817591 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.962601 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817595 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817599 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817602 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817606 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817611 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817615 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817618 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817622 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817626 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817630 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817634 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817638 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817641 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817646 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817650 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817653 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817657 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817661 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817665 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817669 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.963420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817673 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817677 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817681 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817685 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817689 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817694 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817697 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817701 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817705 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817708 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817712 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817717 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817721 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817724 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817729 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817732 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817736 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817739 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817742 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817746 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.964226 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817749 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817753 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817756 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817760 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817764 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817769 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817773 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817779 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817783 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817787 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817793 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817801 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.817808 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817982 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 10:00:41.965011 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817989 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817994 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.817998 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818002 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818009 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818014 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818018 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818022 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818029 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818034 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818039 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818043 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818047 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818051 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818056 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818060 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818064 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818068 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818072 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 10:00:41.965821 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818077 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818084 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818089 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818093 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818097 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818101 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818105 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818109 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818113 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818116 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818121 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818127 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818130 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818134 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818137 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818142 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818145 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818149 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818153 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818156 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 10:00:41.966623 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818160 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818163 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818167 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818170 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818175 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818179 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818183 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818187 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818191 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818194 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818199 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818202 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818205 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818211 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818230 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818234 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818238 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818242 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818246 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818249 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 10:00:41.967443 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818253 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818257 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818261 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818266 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818270 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818274 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818278 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818281 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818285 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818289 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818293 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818297 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818302 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818306 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818309 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818313 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818317 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818321 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818325 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 10:00:41.968241 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818329 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818332 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818336 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818340 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818344 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818348 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818354 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818357 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818361 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818364 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818368 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818371 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818375 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818379 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818383 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818386 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818392 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818396 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818400 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 10:00:41.969041 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:41.818404 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 10:00:41.969841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.818410 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 10:00:41.969841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:41.818545 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.293273 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.294586 2562 server.go:1019] "Starting client certificate rotation" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.294682 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.294726 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.297023 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 10:00:44.307595 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.298432 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 10:00:44.310651 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.308600 2562 log.go:25] "Validated CRI v1 runtime API" Jul 17 10:00:44.340119 ip-10-0-128-133 systemd[1]: Started Kubernetes Kubelet. Jul 17 10:00:44.375645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.310821 2562 log.go:25] "Validated CRI v1 image API" Jul 17 10:00:44.375645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.311664 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 10:00:44.375645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.313952 2562 fs.go:135] Filesystem UUIDs: map[60d4f830-d3af-4801-acdb-4c009b0c975c:/dev/nvme0n1p3 71596bf3-22a8-4573-a1cc-795d03ef1a8d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 17 10:00:44.375645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.313982 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.318796 2562 manager.go:216] Machine: {Timestamp:2026-07-17 10:00:44.318115162 +0000 UTC m=+1.462691725 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100181 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c7172b5bc95ffc72f2d1835a84a27 SystemUUID:ec2c7172-b5bc-95ff-c72f-2d1835a84a27 BootID:c4f7a589-6985-4a4a-b0f7-249e310bd1ac Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:e1:99:36:93 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:e1:99:36:93 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:da:ab:59:2e:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.318920 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.319058 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.320151 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.320175 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.321329 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.321339 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.321347 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.321966 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.323196 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327241 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327362 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327913 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327929 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327943 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327952 2562 kubelet.go:398] "Adding apiserver pod source" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.327960 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 10:00:44.376960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.328292 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.328335 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.331777 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.333760 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.333788 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334860 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334873 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334879 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334885 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334895 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334916 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334929 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334936 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334943 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334949 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334957 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.334963 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.336120 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.336133 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.339290 2562 server.go:1268] "Started kubelet" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.339601 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.339642 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.339650 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.340634 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.340646 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.340858 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.340936 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.341437 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.344686 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.345175 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6df9cebf42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.339265346 +0000 UTC m=+1.483841907,LastTimestamp:2026-07-17 10:00:44.339265346 +0000 UTC m=+1.483841907,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.346957 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.346967 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.347083 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347520 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347646 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347663 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347825 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347834 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.347995 2562 factory.go:55] Registering systemd factory Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348011 2562 factory.go:223] Registration of the systemd container factory successfully Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348202 2562 factory.go:153] Registering CRI-O factory Jul 17 10:00:44.377828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348214 2562 factory.go:223] Registration of the crio container factory successfully Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348279 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348302 2562 factory.go:103] Registering Raw factory Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.348316 2562 manager.go:1196] Started watching for new ooms in manager Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.349118 2562 manager.go:349] Starting recovery of all containers Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.355374 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.355502 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.359595 2562 manager.go:354] Recovery completed Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.365283 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369000 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369028 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369038 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369782 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369791 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.369804 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.370047 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.371384 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb94ae94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.36901442 +0000 UTC m=+1.513590980,LastTimestamp:2026-07-17 10:00:44.36901442 +0000 UTC m=+1.513590980,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372001 2562 policy_none.go:49] "None policy: Start" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372013 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372023 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372931 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372954 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.372964 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.379690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.374065 2562 policy_none.go:47] "Start" Jul 17 10:00:44.386642 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.386571 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb94f414 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.369032212 +0000 UTC m=+1.513608773,LastTimestamp:2026-07-17 10:00:44.369032212 +0000 UTC m=+1.513608773,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.447804 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.447777 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.471619 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.471549 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb9518ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.369041645 +0000 UTC m=+1.513618206,LastTimestamp:2026-07-17 10:00:44.369041645 +0000 UTC m=+1.513618206,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.478769 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.478593 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-133.ec2.internal.18c30b6dfb94ae94\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb94ae94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.36901442 +0000 UTC m=+1.513590980,LastTimestamp:2026-07-17 10:00:44.372941873 +0000 UTC m=+1.517518434,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.484215 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.484159 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-133.ec2.internal.18c30b6dfb94f414\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb94f414 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.369032212 +0000 UTC m=+1.513608773,LastTimestamp:2026-07-17 10:00:44.372958156 +0000 UTC m=+1.517534717,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.484436 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.484418 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 10:00:44.490387 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.490233 2562 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-133.ec2.internal.18c30b6dfb9518ed\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6dfb9518ed default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-133.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.369041645 +0000 UTC m=+1.513618206,LastTimestamp:2026-07-17 10:00:44.372967814 +0000 UTC m=+1.517544375,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.498440 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498427 2562 manager.go:337] "Starting Device Plugin manager" Jul 17 10:00:44.498504 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.498459 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 10:00:44.498504 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498472 2562 server.go:87] "Starting device plugin registration server" Jul 17 10:00:44.498704 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498692 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 10:00:44.498751 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498705 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 10:00:44.498818 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498793 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 10:00:44.498872 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498866 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 10:00:44.498931 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.498874 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 10:00:44.499397 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.499382 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 10:00:44.499468 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.499421 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.503242 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.503184 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-133.ec2.internal.18c30b6e0369e789 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-133.ec2.internal,UID:ip-10-0-128-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-133.ec2.internal,},FirstTimestamp:2026-07-17 10:00:44.500428681 +0000 UTC m=+1.645005233,LastTimestamp:2026-07-17 10:00:44.500428681 +0000 UTC m=+1.645005233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-133.ec2.internal,}" Jul 17 10:00:44.533508 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.533491 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbtz" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.538028 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.539133 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.539170 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.539191 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.539227 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 10:00:44.546046 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.540307 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wtbtz" Jul 17 10:00:44.552112 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.552099 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:44.569680 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.569639 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-133.ec2.internal\" not found" node="ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.599753 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.599736 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.600451 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.600434 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.600530 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.600463 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.600530 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.600478 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.600530 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.600504 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.611281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.611265 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.611318 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.611285 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-133.ec2.internal\": node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.639911 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.639880 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal"] Jul 17 10:00:44.639985 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.639948 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.640615 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.640600 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.640679 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.640628 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.640679 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.640638 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.642801 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.642771 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.642912 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.642885 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.642985 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.642931 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.643409 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643392 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.643482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643420 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.643482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643430 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.643482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643393 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.643482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643458 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.643482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.643471 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.645548 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.645530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.645636 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.645556 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:44.646211 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.646196 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:44.646295 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.646220 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:44.646295 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.646235 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:44.648965 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.648782 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.650570 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.650553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.650639 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.650575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d49fefa60dd8a770e103ab3be5b48825-config\") pod \"kube-apiserver-proxy-ip-10-0-128-133.ec2.internal\" (UID: \"d49fefa60dd8a770e103ab3be5b48825\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.650639 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.650593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.671412 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.671390 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-133.ec2.internal\" not found" node="ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.675537 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.675522 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-133.ec2.internal\" not found" node="ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.748838 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.748817 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.750998 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.750981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.751039 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.751007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.751039 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.751022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d49fefa60dd8a770e103ab3be5b48825-config\") pod \"kube-apiserver-proxy-ip-10-0-128-133.ec2.internal\" (UID: \"d49fefa60dd8a770e103ab3be5b48825\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.751104 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.751060 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d49fefa60dd8a770e103ab3be5b48825-config\") pod \"kube-apiserver-proxy-ip-10-0-128-133.ec2.internal\" (UID: \"d49fefa60dd8a770e103ab3be5b48825\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.751104 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.751071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.751104 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.751084 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf8f1ef2455982ce263ab6a7b542a33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal\" (UID: \"ccf8f1ef2455982ce263ab6a7b542a33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.849728 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.849671 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.950153 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:44.950128 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:44.974433 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.974417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:44.977825 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:44.977807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:45.050976 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.050944 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.151264 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.151207 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.154313 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.154299 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:45.239051 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.239031 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:45.252323 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.252303 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.294661 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.294642 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 10:00:45.294787 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.294770 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 10:00:45.294787 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.294779 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 10:00:45.294872 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.294773 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 10:00:45.352389 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.352369 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.452694 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.452642 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.499883 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.499862 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 10:00:45.502057 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.502036 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientMemory" Jul 17 10:00:45.502136 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.502077 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 10:00:45.502136 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.502094 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeHasSufficientPID" Jul 17 10:00:45.545162 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.545133 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 09:55:44 +0000 UTC" deadline="2028-04-13 00:56:01.775512478 +0000 UTC" Jul 17 10:00:45.545162 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.545160 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15254h55m16.230355943s" Jul 17 10:00:45.553499 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.553478 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.640527 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:45.640498 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd49fefa60dd8a770e103ab3be5b48825.slice/crio-b86020d127558ef27899d3eefea80529ff2b71142580fe3a60f3d6741714d73e WatchSource:0}: Error finding container b86020d127558ef27899d3eefea80529ff2b71142580fe3a60f3d6741714d73e: Status 404 returned error can't find the container with id b86020d127558ef27899d3eefea80529ff2b71142580fe3a60f3d6741714d73e Jul 17 10:00:45.641015 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:45.640994 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf8f1ef2455982ce263ab6a7b542a33.slice/crio-81df2db76ba9d2015d1e34481bfd64b32f08b6ee4498b4c6a93b959338cd7ebf WatchSource:0}: Error finding container 81df2db76ba9d2015d1e34481bfd64b32f08b6ee4498b4c6a93b959338cd7ebf: Status 404 returned error can't find the container with id 81df2db76ba9d2015d1e34481bfd64b32f08b6ee4498b4c6a93b959338cd7ebf Jul 17 10:00:45.646257 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.646241 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 10:00:45.654555 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.654539 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.754962 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.754893 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.855505 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:45.855486 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-133.ec2.internal\" not found" Jul 17 10:00:45.942895 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.941788 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:45.947106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.947082 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" Jul 17 10:00:45.961572 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.961557 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 10:00:45.962156 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.962144 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" Jul 17 10:00:45.977324 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:45.977307 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 10:00:46.329529 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.329498 2562 apiserver.go:52] "Watching apiserver" Jul 17 10:00:46.337471 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.337443 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 10:00:46.339759 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.339733 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-j9lvv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd","openshift-cluster-node-tuning-operator/tuned-hsqfz","openshift-image-registry/node-ca-slzsn","openshift-multus/multus-4l8bx","openshift-network-diagnostics/network-check-target-z6cm7","openshift-network-operator/iptables-alerter-bb6r2","kube-system/global-pull-secret-syncer-klfz9","kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal","openshift-dns/node-resolver-glgzw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal","openshift-multus/multus-additional-cni-plugins-zd697","openshift-multus/network-metrics-daemon-9z2cv","openshift-ovn-kubernetes/ovnkube-node-ggs5j"] Jul 17 10:00:46.342384 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.342365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.344691 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.344667 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.344787 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.344743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:46.345092 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.345071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.345214 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.345192 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.345319 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.345231 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-psjp5\"" Jul 17 10:00:46.347123 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.347104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.347249 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.347225 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 10:00:46.349217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.349197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.351535 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.351314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.352087 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.352072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 10:00:46.352194 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.352072 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.352772 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.352630 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.352772 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.352659 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ftxdw\"" Jul 17 10:00:46.353301 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.352927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bjd29\"" Jul 17 10:00:46.353301 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.353123 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.353857 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.353791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.354336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354035 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 10:00:46.354336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.354336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354281 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.354522 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354354 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n7tx8\"" Jul 17 10:00:46.354522 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354372 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 10:00:46.354681 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.354528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:46.354681 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.354597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:46.356465 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.356195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.357789 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-modprobe-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.357881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-lib-modules\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.357881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-var-lib-kubelet\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.357881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-tmp\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.357881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5tcz\" (UniqueName: \"kubernetes.io/projected/8a1264e1-8272-4540-98f6-b027e3c93aff-kube-api-access-t5tcz\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/959ad77a-2636-46c5-af86-626f298fe5e3-serviceca\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.357986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqnv\" (UniqueName: \"kubernetes.io/projected/87465486-5c8f-454b-9324-7aed59e1e416-kube-api-access-fkqnv\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysconfig\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-kubernetes\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-systemd\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-host\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-tuned\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/959ad77a-2636-46c5-af86-626f298fe5e3-host\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q549\" (UniqueName: \"kubernetes.io/projected/959ad77a-2636-46c5-af86-626f298fe5e3-kube-api-access-5q549\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e88154-8067-47a8-a0df-c4d9d208a3d6-hosts-file\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e88154-8067-47a8-a0df-c4d9d208a3d6-tmp-dir\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbmq\" (UniqueName: \"kubernetes.io/projected/23e88154-8067-47a8-a0df-c4d9d208a3d6-kube-api-access-rpbmq\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-conf\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-run\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358850 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358424 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-sys\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.358850 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.358556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.358850 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.358616 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:46.360198 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.360154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 10:00:46.360198 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.360173 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.360762 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.360732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.361284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.361129 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.361284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.361161 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-56q2l\"" Jul 17 10:00:46.361284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.361183 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 10:00:46.361284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.361205 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 10:00:46.361284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.361213 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 10:00:46.363241 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.363221 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.364444 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.364422 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 10:00:46.366155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.365929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.366678 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.366590 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 10:00:46.367660 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.367640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.367753 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.367670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 10:00:46.368339 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.367799 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4cs2n\"" Jul 17 10:00:46.368767 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.368614 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.368767 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.368693 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 10:00:46.368891 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.368776 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 10:00:46.368891 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.368848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 10:00:46.369180 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.369162 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wwmf6\"" Jul 17 10:00:46.371026 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.369593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.371026 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.369612 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-22kgk\"" Jul 17 10:00:46.373263 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.373231 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:00:46.373450 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.373422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 10:00:46.373522 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.373510 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 10:00:46.373645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.373626 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qfwlw\"" Jul 17 10:00:46.400358 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.400337 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmrt5" Jul 17 10:00:46.409779 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.409757 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tmrt5" Jul 17 10:00:46.449432 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.449395 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 10:00:46.459615 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-slash\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.459723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459628 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rqb9\" (UniqueName: \"kubernetes.io/projected/9c060d38-8107-4194-a1f6-b2170d7c02f5-kube-api-access-8rqb9\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.459723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-tmp\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.459723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-agent-certs\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.459723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.459723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wfcg\" (UniqueName: \"kubernetes.io/projected/6fbf2625-d192-4f7b-a56a-751a143d3352-kube-api-access-7wfcg\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459740 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cni-binary-copy\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-etc-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q549\" (UniqueName: \"kubernetes.io/projected/959ad77a-2636-46c5-af86-626f298fe5e3-kube-api-access-5q549\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-var-lib-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-netns\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459918 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-var-lib-kubelet\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.459995 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.459960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.460399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460082 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-var-lib-kubelet\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.460399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.460399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460355 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 10:00:46.460399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460372 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.460399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-device-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-daemon-config\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-netns\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460491 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-node-log\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460514 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.460611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-iptables-alerter-script\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-registration-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqnv\" (UniqueName: \"kubernetes.io/projected/87465486-5c8f-454b-9324-7aed59e1e416-kube-api-access-fkqnv\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.460667 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-systemd\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.460762 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:46.960739061 +0000 UTC m=+4.105315611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460839 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-systemd\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-tuned\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460892 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/959ad77a-2636-46c5-af86-626f298fe5e3-host\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460938 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/959ad77a-2636-46c5-af86-626f298fe5e3-host\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-konnectivity-ca\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.460991 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.460982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-cnibin\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cnibin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbmq\" (UniqueName: \"kubernetes.io/projected/23e88154-8067-47a8-a0df-c4d9d208a3d6-kube-api-access-rpbmq\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-lib-modules\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-os-release\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-os-release\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-config\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-dbus\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-modprobe-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-system-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461314 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-conf-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-lib-modules\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-ovn\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461337 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-sys-fs\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.461515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461417 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-modprobe-d\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-script-lib\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-kubernetes\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461568 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-kubernetes\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-multus\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461649 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-bin\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-bin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e88154-8067-47a8-a0df-c4d9d208a3d6-hosts-file\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e88154-8067-47a8-a0df-c4d9d208a3d6-tmp-dir\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-conf\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-run\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/959ad77a-2636-46c5-af86-626f298fe5e3-serviceca\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461872 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/23e88154-8067-47a8-a0df-c4d9d208a3d6-hosts-file\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-system-cni-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461895 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-run\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.462276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.461941 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysctl-conf\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-log-socket\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462081 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-k8s-cni-cncf-io\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-kubelet\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23e88154-8067-47a8-a0df-c4d9d208a3d6-tmp-dir\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-socket-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5tcz\" (UniqueName: \"kubernetes.io/projected/8a1264e1-8272-4540-98f6-b027e3c93aff-kube-api-access-t5tcz\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-host-slash\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pgmj\" (UniqueName: \"kubernetes.io/projected/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-kube-api-access-9pgmj\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-kube-api-access-mxf88\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gb4g\" (UniqueName: \"kubernetes.io/projected/f40ef787-15cd-486c-ba04-828a672f9c25-kube-api-access-2gb4g\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462335 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-hostroot\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462359 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-multus-certs\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462360 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/959ad77a-2636-46c5-af86-626f298fe5e3-serviceca\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-kubelet\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-systemd-units\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463069 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-systemd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-netd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysconfig\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-host\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-env-overrides\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovn-node-metrics-cert\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-kubelet-config\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462618 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-sysconfig\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462631 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-host\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-sys\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-socket-dir-parent\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-etc-kubernetes\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.463827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.462734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a1264e1-8272-4540-98f6-b027e3c93aff-sys\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.464382 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.464016 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-etc-tuned\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.464382 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.464051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a1264e1-8272-4540-98f6-b027e3c93aff-tmp\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.467258 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.467238 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:46.470155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.470133 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q549\" (UniqueName: \"kubernetes.io/projected/959ad77a-2636-46c5-af86-626f298fe5e3-kube-api-access-5q549\") pod \"node-ca-slzsn\" (UID: \"959ad77a-2636-46c5-af86-626f298fe5e3\") " pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.470246 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.470178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbmq\" (UniqueName: \"kubernetes.io/projected/23e88154-8067-47a8-a0df-c4d9d208a3d6-kube-api-access-rpbmq\") pod \"node-resolver-glgzw\" (UID: \"23e88154-8067-47a8-a0df-c4d9d208a3d6\") " pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.470246 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.470178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqnv\" (UniqueName: \"kubernetes.io/projected/87465486-5c8f-454b-9324-7aed59e1e416-kube-api-access-fkqnv\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.470685 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.470665 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5tcz\" (UniqueName: \"kubernetes.io/projected/8a1264e1-8272-4540-98f6-b027e3c93aff-kube-api-access-t5tcz\") pod \"tuned-hsqfz\" (UID: \"8a1264e1-8272-4540-98f6-b027e3c93aff\") " pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.546104 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.546047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" event={"ID":"d49fefa60dd8a770e103ab3be5b48825","Type":"ContainerStarted","Data":"b86020d127558ef27899d3eefea80529ff2b71142580fe3a60f3d6741714d73e"} Jul 17 10:00:46.547302 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.547275 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" event={"ID":"ccf8f1ef2455982ce263ab6a7b542a33","Type":"ContainerStarted","Data":"81df2db76ba9d2015d1e34481bfd64b32f08b6ee4498b4c6a93b959338cd7ebf"} Jul 17 10:00:46.563810 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-netns\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-node-log\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-iptables-alerter-script\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-registration-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563915 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-netns\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-konnectivity-ca\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.563946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563943 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563974 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-node-log\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.563991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-registration-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-cnibin\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cnibin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-os-release\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-os-release\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564140 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-cnibin\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-config\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-dbus\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564178 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cnibin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564206 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-os-release\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-system-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-conf-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564250 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-os-release\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-ovn\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564307 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-dbus\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-sys-fs\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564364 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-conf-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-script-lib\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564403 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-multus\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564438 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564445 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-system-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-bin\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-bin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-system-cni-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-sys-fs\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-log-socket\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564548 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-konnectivity-ca\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.564970 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564504 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-ovn\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-k8s-cni-cncf-io\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-log-socket\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564643 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-multus\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-kubelet\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564648 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-bin\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-iptables-alerter-script\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-socket-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564678 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-k8s-cni-cncf-io\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-kubelet\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564598 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-var-lib-cni-bin\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-host-slash\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564719 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-system-cni-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pgmj\" (UniqueName: \"kubernetes.io/projected/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-kube-api-access-9pgmj\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564757 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-host-slash\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-kube-api-access-mxf88\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.565758 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gb4g\" (UniqueName: \"kubernetes.io/projected/f40ef787-15cd-486c-ba04-828a672f9c25-kube-api-access-2gb4g\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-config\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-hostroot\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564761 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-socket-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564867 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovnkube-script-lib\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564877 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-hostroot\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564988 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-multus-certs\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.564991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6fbf2625-d192-4f7b-a56a-751a143d3352-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-kubelet\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565094 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-multus-certs\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565105 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-kubelet\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-systemd-units\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-systemd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565154 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-systemd-units\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-netd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565190 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-cni-netd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.566544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-env-overrides\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovn-node-metrics-cert\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565226 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-run-systemd\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-kubelet-config\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-socket-dir-parent\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-etc-kubernetes\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-slash\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rqb9\" (UniqueName: \"kubernetes.io/projected/9c060d38-8107-4194-a1f6-b2170d7c02f5-kube-api-access-8rqb9\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-agent-certs\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wfcg\" (UniqueName: \"kubernetes.io/projected/6fbf2625-d192-4f7b-a56a-751a143d3352-kube-api-access-7wfcg\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cni-binary-copy\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565449 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-host-slash\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-etc-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565495 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-etc-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.567306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565545 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c060d38-8107-4194-a1f6-b2170d7c02f5-env-overrides\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-var-lib-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565589 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c060d38-8107-4194-a1f6-b2170d7c02f5-var-lib-openvswitch\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-netns\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565621 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565636 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f036d05-90c6-482a-9ce5-93576c140616-kubelet-config\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565680 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-socket-dir-parent\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-device-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-daemon-config\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.565923 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-etc-kubernetes\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.566044 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566048 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-etc-selinux\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-cni-dir\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.566104 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:47.066087297 +0000 UTC m=+4.210663864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:46.568095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566101 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566045 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-host-run-netns\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f40ef787-15cd-486c-ba04-828a672f9c25-device-dir\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-multus-daemon-config\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566630 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566717 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6fbf2625-d192-4f7b-a56a-751a143d3352-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.566801 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-cni-binary-copy\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.567885 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c060d38-8107-4194-a1f6-b2170d7c02f5-ovn-node-metrics-cert\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.568733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.568379 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2-agent-certs\") pod \"konnectivity-agent-j9lvv\" (UID: \"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2\") " pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.576683 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.576660 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gb4g\" (UniqueName: \"kubernetes.io/projected/f40ef787-15cd-486c-ba04-828a672f9c25-kube-api-access-2gb4g\") pod \"aws-ebs-csi-driver-node-n7btd\" (UID: \"f40ef787-15cd-486c-ba04-828a672f9c25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.576960 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.576942 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:00:46.577067 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.576964 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:00:46.577067 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.576979 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:46.577067 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.577051 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:47.077031521 +0000 UTC m=+4.221608072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:46.577939 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.577879 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pgmj\" (UniqueName: \"kubernetes.io/projected/9ff24749-3f44-44e9-a6dd-b66f4449a3c8-kube-api-access-9pgmj\") pod \"iptables-alerter-bb6r2\" (UID: \"9ff24749-3f44-44e9-a6dd-b66f4449a3c8\") " pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.578379 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.578343 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxf88\" (UniqueName: \"kubernetes.io/projected/830eae2d-5aa9-40ff-a368-1a2afdddbe1d-kube-api-access-mxf88\") pod \"multus-4l8bx\" (UID: \"830eae2d-5aa9-40ff-a368-1a2afdddbe1d\") " pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.579417 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.579318 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rqb9\" (UniqueName: \"kubernetes.io/projected/9c060d38-8107-4194-a1f6-b2170d7c02f5-kube-api-access-8rqb9\") pod \"ovnkube-node-ggs5j\" (UID: \"9c060d38-8107-4194-a1f6-b2170d7c02f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.579417 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.579383 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wfcg\" (UniqueName: \"kubernetes.io/projected/6fbf2625-d192-4f7b-a56a-751a143d3352-kube-api-access-7wfcg\") pod \"multus-additional-cni-plugins-zd697\" (UID: \"6fbf2625-d192-4f7b-a56a-751a143d3352\") " pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.653646 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.653579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-glgzw" Jul 17 10:00:46.662640 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.662617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" Jul 17 10:00:46.672106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.672085 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-slzsn" Jul 17 10:00:46.677775 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.677753 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4l8bx" Jul 17 10:00:46.684492 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.684473 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:00:46.692070 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.692050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" Jul 17 10:00:46.700623 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.700605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:00:46.707043 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.707023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zd697" Jul 17 10:00:46.714521 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.714505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bb6r2" Jul 17 10:00:46.968827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:46.968760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:46.968976 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.968868 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:46.968976 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:46.968935 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:47.968921294 +0000 UTC m=+5.113497842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:47.018295 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.018256 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:47.069700 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.069660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:47.069861 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.069833 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:47.069965 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.069949 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:48.069889374 +0000 UTC m=+5.214465926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:47.170081 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.170050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:47.170262 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.170245 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:00:47.170329 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.170274 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:00:47.170329 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.170286 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:47.170429 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.170355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:48.170335438 +0000 UTC m=+5.314911988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:47.257266 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.257232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e88154_8067_47a8_a0df_c4d9d208a3d6.slice/crio-9f1b9a0ff533f5c4116382c35a941b84b7aa6a55dbafb7be7dcb993e1c6077b5 WatchSource:0}: Error finding container 9f1b9a0ff533f5c4116382c35a941b84b7aa6a55dbafb7be7dcb993e1c6077b5: Status 404 returned error can't find the container with id 9f1b9a0ff533f5c4116382c35a941b84b7aa6a55dbafb7be7dcb993e1c6077b5 Jul 17 10:00:47.259159 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.259137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c060d38_8107_4194_a1f6_b2170d7c02f5.slice/crio-06d1167f8769b42a42d9bdec9a8babc8f41456a19a9f52e1efff511f66b4fefd WatchSource:0}: Error finding container 06d1167f8769b42a42d9bdec9a8babc8f41456a19a9f52e1efff511f66b4fefd: Status 404 returned error can't find the container with id 06d1167f8769b42a42d9bdec9a8babc8f41456a19a9f52e1efff511f66b4fefd Jul 17 10:00:47.262993 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.262882 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ee4dce7_74a1_4fa0_98ee_1a502c4e1bc2.slice/crio-463e2b16aba00b09653593ed1b1d128c9070beeec5003de91b70e5deef290289 WatchSource:0}: Error finding container 463e2b16aba00b09653593ed1b1d128c9070beeec5003de91b70e5deef290289: Status 404 returned error can't find the container with id 463e2b16aba00b09653593ed1b1d128c9070beeec5003de91b70e5deef290289 Jul 17 10:00:47.268215 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.268147 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ff24749_3f44_44e9_a6dd_b66f4449a3c8.slice/crio-5384b0ddf0e11007f1f6380b7aa992bb42bc7d9b8405c651a3e2e05f99e4ff2c WatchSource:0}: Error finding container 5384b0ddf0e11007f1f6380b7aa992bb42bc7d9b8405c651a3e2e05f99e4ff2c: Status 404 returned error can't find the container with id 5384b0ddf0e11007f1f6380b7aa992bb42bc7d9b8405c651a3e2e05f99e4ff2c Jul 17 10:00:47.269037 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.269013 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod830eae2d_5aa9_40ff_a368_1a2afdddbe1d.slice/crio-27a314873909f3a67ebd24b6fbdab79aa557e5e657296992d4c5df6344239c55 WatchSource:0}: Error finding container 27a314873909f3a67ebd24b6fbdab79aa557e5e657296992d4c5df6344239c55: Status 404 returned error can't find the container with id 27a314873909f3a67ebd24b6fbdab79aa557e5e657296992d4c5df6344239c55 Jul 17 10:00:47.269717 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.269691 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40ef787_15cd_486c_ba04_828a672f9c25.slice/crio-0aa87f6776ee3d83f966519af511f7c7b71a51ba1453c4e8551b2cbafaa15b0e WatchSource:0}: Error finding container 0aa87f6776ee3d83f966519af511f7c7b71a51ba1453c4e8551b2cbafaa15b0e: Status 404 returned error can't find the container with id 0aa87f6776ee3d83f966519af511f7c7b71a51ba1453c4e8551b2cbafaa15b0e Jul 17 10:00:47.270488 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.270436 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbf2625_d192_4f7b_a56a_751a143d3352.slice/crio-c79c5fdc26b4a9fa0542f4fc8c63a5fc89929202304209dad8e10dc21b607c21 WatchSource:0}: Error finding container c79c5fdc26b4a9fa0542f4fc8c63a5fc89929202304209dad8e10dc21b607c21: Status 404 returned error can't find the container with id c79c5fdc26b4a9fa0542f4fc8c63a5fc89929202304209dad8e10dc21b607c21 Jul 17 10:00:47.290487 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.290468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1264e1_8272_4540_98f6_b027e3c93aff.slice/crio-49a3552629d1b695c626822c062976ceddc3874fa76c6aef0f93232454a05657 WatchSource:0}: Error finding container 49a3552629d1b695c626822c062976ceddc3874fa76c6aef0f93232454a05657: Status 404 returned error can't find the container with id 49a3552629d1b695c626822c062976ceddc3874fa76c6aef0f93232454a05657 Jul 17 10:00:47.291482 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:00:47.291460 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod959ad77a_2636_46c5_af86_626f298fe5e3.slice/crio-2a41be8f70551738d0fa7c76b6a92e05352d912df1830b1d7fd690328ee2d3fe WatchSource:0}: Error finding container 2a41be8f70551738d0fa7c76b6a92e05352d912df1830b1d7fd690328ee2d3fe: Status 404 returned error can't find the container with id 2a41be8f70551738d0fa7c76b6a92e05352d912df1830b1d7fd690328ee2d3fe Jul 17 10:00:47.413407 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.413355 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 09:55:46 +0000 UTC" deadline="2027-12-17 19:45:55.044241461 +0000 UTC" Jul 17 10:00:47.413407 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.413397 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12441h45m7.630848101s" Jul 17 10:00:47.540064 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.539984 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:47.540191 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.540094 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:47.550263 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.550238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"06d1167f8769b42a42d9bdec9a8babc8f41456a19a9f52e1efff511f66b4fefd"} Jul 17 10:00:47.551250 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.551232 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" event={"ID":"f40ef787-15cd-486c-ba04-828a672f9c25","Type":"ContainerStarted","Data":"0aa87f6776ee3d83f966519af511f7c7b71a51ba1453c4e8551b2cbafaa15b0e"} Jul 17 10:00:47.552246 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.552219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerStarted","Data":"c79c5fdc26b4a9fa0542f4fc8c63a5fc89929202304209dad8e10dc21b607c21"} Jul 17 10:00:47.553281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.553255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glgzw" event={"ID":"23e88154-8067-47a8-a0df-c4d9d208a3d6","Type":"ContainerStarted","Data":"9f1b9a0ff533f5c4116382c35a941b84b7aa6a55dbafb7be7dcb993e1c6077b5"} Jul 17 10:00:47.554974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.554945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" event={"ID":"d49fefa60dd8a770e103ab3be5b48825","Type":"ContainerStarted","Data":"b936c046b996184566305d9ca159ea93b6d71d3e5b7d60bedc00d9c992cfbec0"} Jul 17 10:00:47.555924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.555889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slzsn" event={"ID":"959ad77a-2636-46c5-af86-626f298fe5e3","Type":"ContainerStarted","Data":"2a41be8f70551738d0fa7c76b6a92e05352d912df1830b1d7fd690328ee2d3fe"} Jul 17 10:00:47.556800 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.556783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" event={"ID":"8a1264e1-8272-4540-98f6-b027e3c93aff","Type":"ContainerStarted","Data":"49a3552629d1b695c626822c062976ceddc3874fa76c6aef0f93232454a05657"} Jul 17 10:00:47.557672 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.557649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4l8bx" event={"ID":"830eae2d-5aa9-40ff-a368-1a2afdddbe1d","Type":"ContainerStarted","Data":"27a314873909f3a67ebd24b6fbdab79aa557e5e657296992d4c5df6344239c55"} Jul 17 10:00:47.558590 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.558573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb6r2" event={"ID":"9ff24749-3f44-44e9-a6dd-b66f4449a3c8","Type":"ContainerStarted","Data":"5384b0ddf0e11007f1f6380b7aa992bb42bc7d9b8405c651a3e2e05f99e4ff2c"} Jul 17 10:00:47.559480 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.559459 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9lvv" event={"ID":"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2","Type":"ContainerStarted","Data":"463e2b16aba00b09653593ed1b1d128c9070beeec5003de91b70e5deef290289"} Jul 17 10:00:47.724649 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.724590 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 10:00:47.977321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:47.977290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:47.977497 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.977452 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:47.977555 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:47.977526 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:49.977505447 +0000 UTC m=+7.122082003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:48.077928 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.077877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:48.078092 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.078068 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:48.078163 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.078137 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:50.078116809 +0000 UTC m=+7.222693359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:48.179091 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.179008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:48.179248 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.179219 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:00:48.179248 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.179238 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:00:48.179354 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.179250 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:48.179354 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.179310 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:50.179292321 +0000 UTC m=+7.323868872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:48.414355 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.414316 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 09:55:46 +0000 UTC" deadline="2028-04-27 15:03:29.012635046 +0000 UTC" Jul 17 10:00:48.414355 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.414354 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15605h2m40.598285376s" Jul 17 10:00:48.547609 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.547542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:48.547760 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.547680 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:48.547760 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:48.547754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:48.547867 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:48.547817 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:49.539645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:49.539612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:49.540095 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:49.539724 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:49.995851 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:49.995760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:49.996035 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:49.995952 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:49.996035 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:49.996024 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:53.996005816 +0000 UTC m=+11.140582368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:50.096797 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:50.096671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:50.096988 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.096840 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:50.096988 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.096930 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:54.096909974 +0000 UTC m=+11.241486536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:50.197518 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:50.197480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:50.197711 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.197682 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:00:50.197711 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.197711 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:00:50.197820 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.197723 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:50.197820 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.197784 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:00:54.197764808 +0000 UTC m=+11.342341373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:50.541511 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:50.541019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:50.541511 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.541156 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:50.542042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:50.541640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:50.542042 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:50.541759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:51.540015 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:51.539715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:51.540172 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:51.540124 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:52.542054 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:52.540127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:52.542054 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:52.540277 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:52.542054 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:52.540331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:52.542054 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:52.540451 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:53.539806 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:53.539775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:53.539983 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:53.539925 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:54.029837 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:54.029759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:54.030296 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.029928 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:54.030296 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.030004 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:02.029980766 +0000 UTC m=+19.174557328 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:00:54.131231 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:54.131188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:54.131403 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.131385 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:54.131464 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.131452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:02.131433533 +0000 UTC m=+19.276010083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:00:54.233187 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:54.232595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:54.233187 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.232757 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:00:54.233187 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.232781 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:00:54.233187 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.232793 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:54.233187 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.232847 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:02.232829521 +0000 UTC m=+19.377406084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:00:54.541853 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:54.541252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:54.541853 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.541370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:54.541853 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:54.541728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:54.541853 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:54.541812 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:55.540827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:55.540332 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:55.540827 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:55.540478 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:56.540327 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:56.540289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:56.540513 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:56.540338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:56.540513 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:56.540408 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:56.540637 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:56.540544 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:57.540360 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:57.540324 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:57.540693 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:57.540440 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:00:58.539711 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:58.539675 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:00:58.539876 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:58.539799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:00:58.539876 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:58.539852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:00:58.540086 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:58.540000 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:00:59.540054 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:00:59.540019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:00:59.540478 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:00:59.540144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:00.539806 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:00.539768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:00.540011 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:00.539933 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:00.540079 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:00.539784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:00.540449 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:00.540153 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:01.539766 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:01.539730 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:01.539932 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:01.539842 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:02.091587 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:02.091546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:02.092111 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.091713 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:01:02.092111 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.091785 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:18.091762991 +0000 UTC m=+35.236339540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:01:02.192393 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:02.192350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:02.192628 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.192543 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:01:02.192628 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.192623 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:18.192602548 +0000 UTC m=+35.337179098 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:01:02.293477 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:02.293441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:02.293650 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.293621 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:01:02.293650 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.293648 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:01:02.293763 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.293660 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:01:02.293763 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.293726 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:18.293708073 +0000 UTC m=+35.438284627 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:01:02.539795 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:02.539700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:02.539795 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:02.539744 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:02.540036 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.539848 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:02.540036 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:02.539985 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:03.539887 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:03.539848 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:03.540361 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:03.539996 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:04.540539 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:04.540510 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:04.541001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:04.540617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:04.541001 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:04.540658 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:04.541001 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:04.540758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:05.539914 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:05.539861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:05.540096 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:05.539997 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:06.542347 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.541424 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:06.542347 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:06.541738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:06.542347 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.542066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:06.542347 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:06.542160 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:06.600602 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.600483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" event={"ID":"8a1264e1-8272-4540-98f6-b027e3c93aff","Type":"ContainerStarted","Data":"3278a6ab7d73266e1186c5bb7f3f24f4b9554d248ab2ef29b4592ed6fe67e825"} Jul 17 10:01:06.602238 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.602197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4l8bx" event={"ID":"830eae2d-5aa9-40ff-a368-1a2afdddbe1d","Type":"ContainerStarted","Data":"fe0f4fc4df9fbd78389d0aedf62066bdf2329b76bf33f3baa026562b5973e23c"} Jul 17 10:01:06.603914 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.603880 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9lvv" event={"ID":"6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2","Type":"ContainerStarted","Data":"e9f9a9c4eca721264dab6b745b9b7b8671d64c05c4188893e46b0660cd507740"} Jul 17 10:01:06.605851 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.605828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"86ab7a661ba3214bcff2f546b67d5b5767e5f1d742fdae686dd65c2e0de110cb"} Jul 17 10:01:06.605965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.605928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"dd081e7c916a1d71bdb5b0806a519c19156cfe17d640c662176cbab2e6770202"} Jul 17 10:01:06.607231 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.607210 2562 generic.go:356] "Generic (PLEG): container finished" podID="ccf8f1ef2455982ce263ab6a7b542a33" containerID="dd2f2f49e419f9cc1fdebfe71c1539f8ba23e91be20c8152862be2b79620000b" exitCode=0 Jul 17 10:01:06.607310 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.607268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" event={"ID":"ccf8f1ef2455982ce263ab6a7b542a33","Type":"ContainerDied","Data":"dd2f2f49e419f9cc1fdebfe71c1539f8ba23e91be20c8152862be2b79620000b"} Jul 17 10:01:06.608865 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.608830 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" event={"ID":"f40ef787-15cd-486c-ba04-828a672f9c25","Type":"ContainerStarted","Data":"1f82a8a6739d425238cf0300563b0768db4f250b3b7f910b0cf1a05a33ae9d46"} Jul 17 10:01:06.610507 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.610481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerStarted","Data":"093036ee239625161784e37b74ed7dfe6d0c6ebfcb497c36317e07c7fcf9f5e9"} Jul 17 10:01:06.612025 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.612001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-glgzw" event={"ID":"23e88154-8067-47a8-a0df-c4d9d208a3d6","Type":"ContainerStarted","Data":"e3241633b2788d4c2676f8b9b671c96618b7aa2aa5a8a9344660a393493caddd"} Jul 17 10:01:06.613251 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.613230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-slzsn" event={"ID":"959ad77a-2636-46c5-af86-626f298fe5e3","Type":"ContainerStarted","Data":"b5a1c2f0707a1daae104e5641b07e5dc06ad0b9b296d73c364418ea430ae4d3a"} Jul 17 10:01:06.641157 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.641102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hsqfz" podStartSLOduration=4.020221543 podStartE2EDuration="22.64106715s" totalImagesPullingTime="18.620845607s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:06.635282196 +0000 UTC m=+23.779858766" watchObservedRunningTime="2026-07-17 10:01:06.64106715 +0000 UTC m=+23.785643709" Jul 17 10:01:06.641473 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.641451 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-133.ec2.internal" podStartSLOduration=21.641443267 podStartE2EDuration="21.641443267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:00:47.576591145 +0000 UTC m=+4.721167714" watchObservedRunningTime="2026-07-17 10:01:06.641443267 +0000 UTC m=+23.786019898" Jul 17 10:01:06.677587 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.677538 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9lvv" podStartSLOduration=4.079606619 podStartE2EDuration="22.677523192s" totalImagesPullingTime="18.597916573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:06.676789939 +0000 UTC m=+23.821366508" watchObservedRunningTime="2026-07-17 10:01:06.677523192 +0000 UTC m=+23.822099762" Jul 17 10:01:06.806730 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.806687 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-glgzw" podStartSLOduration=12.606077428999999 podStartE2EDuration="22.806671005s" totalImagesPullingTime="10.200593576s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:06.754594626 +0000 UTC m=+23.899171197" watchObservedRunningTime="2026-07-17 10:01:06.806671005 +0000 UTC m=+23.951247574" Jul 17 10:01:06.858236 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:06.858187 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-slzsn" podStartSLOduration=4.236507564 podStartE2EDuration="22.858167298s" totalImagesPullingTime="18.621659734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:06.857366688 +0000 UTC m=+24.001943257" watchObservedRunningTime="2026-07-17 10:01:06.858167298 +0000 UTC m=+24.002743871" Jul 17 10:01:07.265410 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.265223 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:01:07.265782 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.265768 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:01:07.288965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.288916 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4l8bx" podStartSLOduration=4.629543628 podStartE2EDuration="23.288884459s" totalImagesPullingTime="18.659340831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:06.894942304 +0000 UTC m=+24.039518874" watchObservedRunningTime="2026-07-17 10:01:07.288884459 +0000 UTC m=+24.433461029" Jul 17 10:01:07.539406 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.539376 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:07.539608 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:07.539491 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:07.616534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.616502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bb6r2" event={"ID":"9ff24749-3f44-44e9-a6dd-b66f4449a3c8","Type":"ContainerStarted","Data":"1433403606d1e37d494b0e62dd3f181451734b89e88fc635b4453492491e1c84"} Jul 17 10:01:07.619527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.619502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"4cf2fc790f24bfc15fe786a4d5c4f3f9c6d751c2e35d243f741d6d6091629c0c"} Jul 17 10:01:07.619652 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.619569 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"2859a5ccf8f526027d47ba0a9c037ac9c08427893eac89544404abec27e22e36"} Jul 17 10:01:07.619652 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.619615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"420cbd2cf54971d2009dbedc74f819a5ae32918c4e885cf12ad830256cf7d8c9"} Jul 17 10:01:07.619652 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.619649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"c4a1fc43421b4f76f592a6a481eb1c5d2ee1a163f1e9709d01a314bd2dbea912"} Jul 17 10:01:07.621118 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.621095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" event={"ID":"ccf8f1ef2455982ce263ab6a7b542a33","Type":"ContainerStarted","Data":"1eef510bd8235753c28f67a8160fc4577c52c2adbea5c5132b5c9314a37c04ac"} Jul 17 10:01:07.622479 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.622447 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="093036ee239625161784e37b74ed7dfe6d0c6ebfcb497c36317e07c7fcf9f5e9" exitCode=0 Jul 17 10:01:07.622556 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.622534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"093036ee239625161784e37b74ed7dfe6d0c6ebfcb497c36317e07c7fcf9f5e9"} Jul 17 10:01:07.675089 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.675037 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bb6r2" podStartSLOduration=4.049274118 podStartE2EDuration="22.675020319s" totalImagesPullingTime="18.625746201s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:07.652145159 +0000 UTC m=+24.796721741" watchObservedRunningTime="2026-07-17 10:01:07.675020319 +0000 UTC m=+24.819596943" Jul 17 10:01:07.711445 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.711393 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-133.ec2.internal" podStartSLOduration=22.711377872 podStartE2EDuration="22.711377872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:07.675551519 +0000 UTC m=+24.820128089" watchObservedRunningTime="2026-07-17 10:01:07.711377872 +0000 UTC m=+24.855954442" Jul 17 10:01:07.888737 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:07.888698 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 10:01:08.222772 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.222687 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:01:08.223391 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.223369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9lvv" Jul 17 10:01:08.510304 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.510209 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T10:01:07.888715385Z","UUID":"8f6a9511-79f7-407a-97f6-9b72d4349d3e","Handler":null,"Name":"","Endpoint":""} Jul 17 10:01:08.512593 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.512575 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 10:01:08.512709 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.512611 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 10:01:08.539850 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.539818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:08.540015 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.539826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:08.540015 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:08.539968 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:08.540015 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:08.539986 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:08.626743 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:08.626701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" event={"ID":"f40ef787-15cd-486c-ba04-828a672f9c25","Type":"ContainerStarted","Data":"83715b84134f2b8b0028da997072056a21f088c95b2eb2cd5d4672fd30e683b8"} Jul 17 10:01:09.539918 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:09.539869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:09.540095 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:09.540034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:09.632781 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:09.632741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"5c525f06f0c493da854ff0fad9af209ce5b24355570ea0e3e75f8b76d6e2029e"} Jul 17 10:01:10.539491 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:10.539453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:10.539698 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:10.539466 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:10.539698 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:10.539584 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:10.539698 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:10.539661 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:11.539604 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.539571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:11.540274 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:11.539694 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:11.639544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.639507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" event={"ID":"f40ef787-15cd-486c-ba04-828a672f9c25","Type":"ContainerStarted","Data":"bf3231775ddbe223c7c5393e38b2dd3c2f5e60cce9bc8505e2679a8b667b8773"} Jul 17 10:01:11.643497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.643467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" event={"ID":"9c060d38-8107-4194-a1f6-b2170d7c02f5","Type":"ContainerStarted","Data":"8d634c41a494d29ed7569a1104307336305fa5e684706cc5914c986edc34ed9e"} Jul 17 10:01:11.643774 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.643752 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:11.643863 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.643830 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:11.659990 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.659954 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:11.726442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.726385 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" podStartSLOduration=8.608177024 podStartE2EDuration="27.726367667s" totalImagesPullingTime="19.118190643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:11.72618511 +0000 UTC m=+28.870761716" watchObservedRunningTime="2026-07-17 10:01:11.726367667 +0000 UTC m=+28.870944250" Jul 17 10:01:11.726625 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:11.726602 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n7btd" podStartSLOduration=5.025639317 podStartE2EDuration="27.726593902s" totalImagesPullingTime="22.700954585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:11.664242345 +0000 UTC m=+28.808818917" watchObservedRunningTime="2026-07-17 10:01:11.726593902 +0000 UTC m=+28.871170472" Jul 17 10:01:12.539894 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:12.539853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:12.539894 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:12.539854 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:12.540492 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:12.540016 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:12.540492 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:12.540123 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:12.646965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:12.646938 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:12.663250 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:12.663219 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:13.539384 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.539357 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:13.539555 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:13.539487 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:13.650450 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.650417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerStarted","Data":"aafb56d72f2aaf0e3b7eca249625882e960cae0579bd91371841de9d2a8fa9e7"} Jul 17 10:01:13.976154 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.975933 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9z2cv"] Jul 17 10:01:13.976272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.976195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:13.976326 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:13.976280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:13.985264 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.985238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klfz9"] Jul 17 10:01:13.985385 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.985320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:13.985421 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:13.985398 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:13.989655 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.989634 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6cm7"] Jul 17 10:01:13.989754 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:13.989720 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:13.989811 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:13.989794 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:14.654560 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:14.654523 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="aafb56d72f2aaf0e3b7eca249625882e960cae0579bd91371841de9d2a8fa9e7" exitCode=0 Jul 17 10:01:14.654942 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:14.654596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"aafb56d72f2aaf0e3b7eca249625882e960cae0579bd91371841de9d2a8fa9e7"} Jul 17 10:01:15.540268 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:15.540150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:15.540268 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:15.540189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:15.540268 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:15.540189 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:15.540505 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:15.540280 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:15.540505 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:15.540365 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:15.540505 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:15.540452 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:16.661016 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:16.660980 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="dc05e49214469fd8e20d1fa8886ca9a36f5c2be7afc8adefad72275e5aa0d36f" exitCode=0 Jul 17 10:01:16.661470 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:16.661042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"dc05e49214469fd8e20d1fa8886ca9a36f5c2be7afc8adefad72275e5aa0d36f"} Jul 17 10:01:17.539623 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:17.539585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:17.539790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:17.539586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:17.539790 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:17.539691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:17.539869 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:17.539793 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:17.539869 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:17.539586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:17.539960 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:17.539881 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:18.104815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:18.104777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:18.105217 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.104934 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:01:18.105217 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.104991 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs podName:87465486-5c8f-454b-9324-7aed59e1e416 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:50.104977322 +0000 UTC m=+67.249553874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs") pod "network-metrics-daemon-9z2cv" (UID: "87465486-5c8f-454b-9324-7aed59e1e416") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 10:01:18.205599 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:18.205562 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:18.205755 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.205704 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 10:01:18.205797 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.205761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret podName:7f036d05-90c6-482a-9ce5-93576c140616 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:50.205745174 +0000 UTC m=+67.350321723 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret") pod "global-pull-secret-syncer-klfz9" (UID: "7f036d05-90c6-482a-9ce5-93576c140616") : object "kube-system"/"original-pull-secret" not registered Jul 17 10:01:18.306102 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:18.306065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:18.306258 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.306207 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 10:01:18.306258 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.306221 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 10:01:18.306258 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.306241 2562 projected.go:196] Error preparing data for projected volume kube-api-access-r76jc for pod openshift-network-diagnostics/network-check-target-z6cm7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:01:18.306380 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:18.306289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc podName:32b5041f-7636-49c6-9306-5f90606cae58 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:50.306277704 +0000 UTC m=+67.450854252 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r76jc" (UniqueName: "kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc") pod "network-check-target-z6cm7" (UID: "32b5041f-7636-49c6-9306-5f90606cae58") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 10:01:18.668001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:18.667917 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="7fa9e83760b2b0af37f8b9adedd553553928789268c3e70e827ed1ac51d1616c" exitCode=0 Jul 17 10:01:18.668001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:18.667968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"7fa9e83760b2b0af37f8b9adedd553553928789268c3e70e827ed1ac51d1616c"} Jul 17 10:01:19.540379 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:19.540344 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:19.540379 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:19.540362 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:19.540879 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:19.540472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:19.540879 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:19.540489 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6cm7" podUID="32b5041f-7636-49c6-9306-5f90606cae58" Jul 17 10:01:19.540879 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:19.540633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z2cv" podUID="87465486-5c8f-454b-9324-7aed59e1e416" Jul 17 10:01:19.540879 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:19.540722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-klfz9" podUID="7f036d05-90c6-482a-9ce5-93576c140616" Jul 17 10:01:20.138318 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.138122 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-133.ec2.internal" event="NodeReady" Jul 17 10:01:20.138589 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.138456 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 10:01:20.237286 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.237256 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:01:20.264061 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.263977 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.265453 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.265432 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4l5d"] Jul 17 10:01:20.270074 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.270049 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 10:01:20.270360 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.270343 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 10:01:20.270500 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.270480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 10:01:20.270705 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.270690 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dl28k\"" Jul 17 10:01:20.279943 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.279918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.288544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.288520 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4l5d"] Jul 17 10:01:20.288648 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.288543 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 10:01:20.289974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.289958 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 10:01:20.290942 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.290922 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vz6sd\"" Jul 17 10:01:20.291041 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.290950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 10:01:20.304553 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.304532 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:01:20.316265 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.316245 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-tf8n7"] Jul 17 10:01:20.340035 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.340014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.343376 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.343356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf8n7"] Jul 17 10:01:20.344424 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.344406 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pw726\"" Jul 17 10:01:20.344521 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.344511 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 10:01:20.344577 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.344520 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 10:01:20.351920 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.349169 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 10:01:20.424009 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.423934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424009 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.423965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czzxl\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424009 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.423996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-config-volume\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.424217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.424217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424320 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcln9\" (UniqueName: \"kubernetes.io/projected/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-kube-api-access-rcln9\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.424320 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-cert\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.424320 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkqrt\" (UniqueName: \"kubernetes.io/projected/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-kube-api-access-qkqrt\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.424320 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-tmp-dir\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.424320 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424477 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424477 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.424477 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.424396 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525470 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.525470 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525664 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525664 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:20.525585 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:20.525664 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525618 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcln9\" (UniqueName: \"kubernetes.io/projected/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-kube-api-access-rcln9\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.525664 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:20.525659 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:21.02564277 +0000 UTC m=+38.170219318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-cert\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkqrt\" (UniqueName: \"kubernetes.io/projected/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-kube-api-access-qkqrt\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-tmp-dir\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525755 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.525866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525845 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czzxl\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525960 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.525983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-config-volume\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:20.526138 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.526144 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-tmp-dir\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:20.526156 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:20.526233 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:20.526223 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:21.02620467 +0000 UTC m=+38.170781221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:20.526560 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.526421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.526560 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.526551 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-config-volume\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.527012 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.526991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.529809 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.529789 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.529909 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.529812 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.529909 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.529846 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-cert\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.538398 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.538372 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkqrt\" (UniqueName: \"kubernetes.io/projected/7ff92ac6-9c9b-40e2-996b-e81bcd14296a-kube-api-access-qkqrt\") pod \"ingress-canary-tf8n7\" (UID: \"7ff92ac6-9c9b-40e2-996b-e81bcd14296a\") " pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.538726 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.538703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czzxl\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.539352 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.539331 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcln9\" (UniqueName: \"kubernetes.io/projected/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-kube-api-access-rcln9\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:20.539783 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.539763 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:20.654110 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.654078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-tf8n7" Jul 17 10:01:20.912237 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:20.912197 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-tf8n7"] Jul 17 10:01:20.916326 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:20.916301 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff92ac6_9c9b_40e2_996b_e81bcd14296a.slice/crio-942ddef25c4d1360f8ef060f4a8fca9b792b29d03a62a050cfb7fec7f5211a8a WatchSource:0}: Error finding container 942ddef25c4d1360f8ef060f4a8fca9b792b29d03a62a050cfb7fec7f5211a8a: Status 404 returned error can't find the container with id 942ddef25c4d1360f8ef060f4a8fca9b792b29d03a62a050cfb7fec7f5211a8a Jul 17 10:01:21.030392 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.030366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:21.030538 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.030428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:21.030538 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:21.030512 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:21.030610 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:21.030543 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:21.030610 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:21.030553 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:21.030610 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:21.030572 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:22.030557951 +0000 UTC m=+39.175134499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:21.030610 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:21.030590 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:22.030579042 +0000 UTC m=+39.175155602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:21.540281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.540209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:21.540281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.540253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:21.540509 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.540447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:21.543364 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.543340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 10:01:21.543949 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.543926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 10:01:21.544068 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.543927 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 10:01:21.544370 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.544351 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2zq6\"" Jul 17 10:01:21.544932 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.544857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mmk8\"" Jul 17 10:01:21.545112 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.544940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 10:01:21.676663 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:21.676621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf8n7" event={"ID":"7ff92ac6-9c9b-40e2-996b-e81bcd14296a","Type":"ContainerStarted","Data":"942ddef25c4d1360f8ef060f4a8fca9b792b29d03a62a050cfb7fec7f5211a8a"} Jul 17 10:01:22.037846 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:22.037821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:22.038032 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:22.037882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:22.038032 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:22.037982 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:22.038032 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:22.038013 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:22.038166 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:22.038035 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:22.038166 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:22.038041 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:24.038024818 +0000 UTC m=+41.182601373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:22.038166 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:22.038094 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:24.038075135 +0000 UTC m=+41.182651701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:23.902636 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:23.902413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:24.001772 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:24.001736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:24.054094 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:24.054057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:24.054240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:24.054154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:24.054240 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:24.054190 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:24.054341 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:24.054259 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:28.054238388 +0000 UTC m=+45.198814958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:24.054341 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:24.054270 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:24.054341 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:24.054281 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:24.054341 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:24.054326 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:28.054315086 +0000 UTC m=+45.198891634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:25.688345 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:25.688316 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="3b5bbf7aff0ea9ca2a444a77739633a000a9e5088a00aaa343a944f06b57bd93" exitCode=0 Jul 17 10:01:25.688756 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:25.688386 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"3b5bbf7aff0ea9ca2a444a77739633a000a9e5088a00aaa343a944f06b57bd93"} Jul 17 10:01:25.689839 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:25.689814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-tf8n7" event={"ID":"7ff92ac6-9c9b-40e2-996b-e81bcd14296a","Type":"ContainerStarted","Data":"0a03f282dd5bcdfafa717e6779ee856c8f073df2fb0e5aea5afc4dda10922508"} Jul 17 10:01:26.695170 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:26.695135 2562 generic.go:356] "Generic (PLEG): container finished" podID="6fbf2625-d192-4f7b-a56a-751a143d3352" containerID="3bb2a329d073a726b33c2746a402ef1642948279288739bacf9955c10d574e16" exitCode=0 Jul 17 10:01:26.695519 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:26.695215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerDied","Data":"3bb2a329d073a726b33c2746a402ef1642948279288739bacf9955c10d574e16"} Jul 17 10:01:26.724393 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:26.724351 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-tf8n7" podStartSLOduration=2.6138792239999997 podStartE2EDuration="6.724335484s" totalImagesPullingTime="4.11045626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:25.734871068 +0000 UTC m=+42.879447639" watchObservedRunningTime="2026-07-17 10:01:26.724335484 +0000 UTC m=+43.868912057" Jul 17 10:01:27.700798 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:27.700765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd697" event={"ID":"6fbf2625-d192-4f7b-a56a-751a143d3352","Type":"ContainerStarted","Data":"f23867c302cfb60fdc47629365d9bf490c32dcdb2441188f822b77420e1da671"} Jul 17 10:01:27.742555 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:27.742507 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zd697" podStartSLOduration=9.789405644 podStartE2EDuration="43.742493012s" totalImagesPullingTime="33.953087368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:27.742481804 +0000 UTC m=+44.887058373" watchObservedRunningTime="2026-07-17 10:01:27.742493012 +0000 UTC m=+44.887069581" Jul 17 10:01:28.079538 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:28.079510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:28.079679 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:28.079560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:28.079679 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:28.079631 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:28.079679 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:28.079643 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:28.079790 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:28.079682 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:36.079670202 +0000 UTC m=+53.224246750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:28.079790 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:28.079645 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:28.079790 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:28.079753 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:36.079740543 +0000 UTC m=+53.224317091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:30.442695 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.442658 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5"] Jul 17 10:01:30.470328 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.470299 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-ckg48"] Jul 17 10:01:30.470474 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.470408 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.476335 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.476302 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pxqs6\"" Jul 17 10:01:30.476335 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.476326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 10:01:30.476536 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.476328 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.476536 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.476362 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 10:01:30.476609 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.476546 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.484067 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.484046 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5"] Jul 17 10:01:30.484160 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.484073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-ckg48"] Jul 17 10:01:30.484160 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.484133 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.488605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.488587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 10:01:30.488693 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.488626 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 10:01:30.488944 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.488928 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-792xq\"" Jul 17 10:01:30.489148 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.489132 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.489253 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.489238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.493632 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.493611 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 10:01:30.542940 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.542922 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6"] Jul 17 10:01:30.561178 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.561157 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf"] Jul 17 10:01:30.561289 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.561267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.566036 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.566020 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 10:01:30.566120 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.566098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.566501 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.566482 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.566834 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.566816 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 10:01:30.567272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.567256 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-q57nx\"" Jul 17 10:01:30.583594 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.583570 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kjl8j"] Jul 17 10:01:30.583739 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.583721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.591808 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.591787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 10:01:30.592386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.592366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.592866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.592849 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b8hnx\"" Jul 17 10:01:30.592977 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.592929 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.595191 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.595272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595212 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-snapshots\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.595272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595229 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swq5\" (UniqueName: \"kubernetes.io/projected/fb706e28-7cc9-4982-88d4-833d3f0f1957-kube-api-access-6swq5\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.595272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.595272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-tmp\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.595478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t54qt\" (UniqueName: \"kubernetes.io/projected/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-kube-api-access-t54qt\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.595478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-service-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.595478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.595478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.595462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb706e28-7cc9-4982-88d4-833d3f0f1957-serving-cert\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.605124 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.605105 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-696d6cd74-glp2h"] Jul 17 10:01:30.605257 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.605244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.610272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.610252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 10:01:30.610272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.610265 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.610493 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.610477 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pnrd6\"" Jul 17 10:01:30.610536 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.610523 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.610760 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.610744 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 10:01:30.618628 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.618606 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 10:01:30.623626 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.623611 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8"] Jul 17 10:01:30.623732 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.623722 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.628041 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628020 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 10:01:30.628041 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628032 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.628184 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.628339 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 10:01:30.628624 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n6x6j\"" Jul 17 10:01:30.628862 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.628847 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 10:01:30.629631 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.629616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 10:01:30.642067 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6"] Jul 17 10:01:30.642159 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" Jul 17 10:01:30.642213 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf"] Jul 17 10:01:30.642258 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-696d6cd74-glp2h"] Jul 17 10:01:30.642258 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8"] Jul 17 10:01:30.642258 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.642256 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kjl8j"] Jul 17 10:01:30.651512 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.651454 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.651607 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.651587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-hbkpk\"" Jul 17 10:01:30.652392 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.652375 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd"] Jul 17 10:01:30.652574 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.652561 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.668657 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.668640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" Jul 17 10:01:30.669727 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.669708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd"] Jul 17 10:01:30.672214 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.672199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-d5tgk\"" Jul 17 10:01:30.695784 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6ckd\" (UniqueName: \"kubernetes.io/projected/f070df22-8f07-4e1a-910a-8ece9bca98d3-kube-api-access-x6ckd\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.695784 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.695924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzj8\" (UniqueName: \"kubernetes.io/projected/83df9797-1769-4cb1-9872-8e72f02f039a-kube-api-access-4hzj8\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.695924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-trusted-ca\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.695924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695831 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83df9797-1769-4cb1-9872-8e72f02f039a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.695924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-snapshots\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.695990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-config\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070df22-8f07-4e1a-910a-8ece9bca98d3-serving-cert\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6swq5\" (UniqueName: \"kubernetes.io/projected/fb706e28-7cc9-4982-88d4-833d3f0f1957-kube-api-access-6swq5\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.696106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-tmp\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t54qt\" (UniqueName: \"kubernetes.io/projected/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-kube-api-access-t54qt\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-service-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb706e28-7cc9-4982-88d4-833d3f0f1957-serving-cert\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83df9797-1769-4cb1-9872-8e72f02f039a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.696386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhrjw\" (UniqueName: \"kubernetes.io/projected/c5d2cc07-f182-4962-9afe-c48f66d50244-kube-api-access-nhrjw\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.696664 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.696446 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:30.696664 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.696507 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:01:31.19649002 +0000 UTC m=+48.341066590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:30.696664 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696549 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.698984 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.696833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.698984 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.697494 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-tmp\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.698984 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.697587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/fb706e28-7cc9-4982-88d4-833d3f0f1957-snapshots\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.698984 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.697836 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb706e28-7cc9-4982-88d4-833d3f0f1957-service-ca-bundle\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.698984 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.698728 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886"] Jul 17 10:01:30.699276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.699252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:30.700177 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.700159 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fb706e28-7cc9-4982-88d4-833d3f0f1957-serving-cert\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.720728 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.720705 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t54qt\" (UniqueName: \"kubernetes.io/projected/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-kube-api-access-t54qt\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:30.720960 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.720942 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swq5\" (UniqueName: \"kubernetes.io/projected/fb706e28-7cc9-4982-88d4-833d3f0f1957-kube-api-access-6swq5\") pod \"insights-operator-555d9d7885-ckg48\" (UID: \"fb706e28-7cc9-4982-88d4-833d3f0f1957\") " pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.723738 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.723719 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886"] Jul 17 10:01:30.723836 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.723822 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:30.728825 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.728805 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 10:01:30.728963 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.728827 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 10:01:30.728963 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.728828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2mtqq\"" Jul 17 10:01:30.729272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.729258 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:30.729342 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.729292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 10:01:30.777971 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.777928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:30.792264 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.792247 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-ckg48" Jul 17 10:01:30.797548 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.797610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hh9c\" (UniqueName: \"kubernetes.io/projected/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-kube-api-access-2hh9c\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.797610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lml2\" (UniqueName: \"kubernetes.io/projected/01ae2933-affc-47e6-ab26-ab14dbc7e6d9-kube-api-access-9lml2\") pod \"volume-data-source-validator-78cf4c6f6-7qpq8\" (UID: \"01ae2933-affc-47e6-ab26-ab14dbc7e6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" Jul 17 10:01:30.797610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-stats-auth\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.797729 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.797729 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83df9797-1769-4cb1-9872-8e72f02f039a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.797729 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.797656 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 10:01:30.797840 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.797767 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls podName:c5d2cc07-f182-4962-9afe-c48f66d50244 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:31.297752893 +0000 UTC m=+48.442329440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-scxqf" (UID: "c5d2cc07-f182-4962-9afe-c48f66d50244") : secret "samples-operator-tls" not found Jul 17 10:01:30.797840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-default-certificate\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.797840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhrjw\" (UniqueName: \"kubernetes.io/projected/c5d2cc07-f182-4962-9afe-c48f66d50244-kube-api-access-nhrjw\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.798042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6ckd\" (UniqueName: \"kubernetes.io/projected/f070df22-8f07-4e1a-910a-8ece9bca98d3-kube-api-access-x6ckd\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.798042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.798042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzj8\" (UniqueName: \"kubernetes.io/projected/83df9797-1769-4cb1-9872-8e72f02f039a-kube-api-access-4hzj8\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.798042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.797997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-trusted-ca\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.798042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83df9797-1769-4cb1-9872-8e72f02f039a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.798307 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-config\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.798307 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crbv2\" (UniqueName: \"kubernetes.io/projected/745fe5cc-27ac-4647-a5a3-074547162981-kube-api-access-crbv2\") pod \"network-check-source-7bc5b6bf85-8pzsd\" (UID: \"745fe5cc-27ac-4647-a5a3-074547162981\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" Jul 17 10:01:30.798307 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070df22-8f07-4e1a-910a-8ece9bca98d3-serving-cert\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.798307 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/83df9797-1769-4cb1-9872-8e72f02f039a-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.798852 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.798832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-config\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.799317 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.799301 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f070df22-8f07-4e1a-910a-8ece9bca98d3-trusted-ca\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.800292 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.800274 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/83df9797-1769-4cb1-9872-8e72f02f039a-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.800375 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.800339 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f070df22-8f07-4e1a-910a-8ece9bca98d3-serving-cert\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.813919 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.813883 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzj8\" (UniqueName: \"kubernetes.io/projected/83df9797-1769-4cb1-9872-8e72f02f039a-kube-api-access-4hzj8\") pod \"kube-storage-version-migrator-operator-7658d9b749-4n4s6\" (UID: \"83df9797-1769-4cb1-9872-8e72f02f039a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.814139 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.814123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhrjw\" (UniqueName: \"kubernetes.io/projected/c5d2cc07-f182-4962-9afe-c48f66d50244-kube-api-access-nhrjw\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:30.814348 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.814333 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6ckd\" (UniqueName: \"kubernetes.io/projected/f070df22-8f07-4e1a-910a-8ece9bca98d3-kube-api-access-x6ckd\") pod \"console-operator-565b7b569d-kjl8j\" (UID: \"f070df22-8f07-4e1a-910a-8ece9bca98d3\") " pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.863999 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.863974 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:30.869835 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.869812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" Jul 17 10:01:30.899459 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.899566 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d252-de24-473c-9e61-ec845ad6e249-config\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:30.899566 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9wxn\" (UniqueName: \"kubernetes.io/projected/3bf9d252-de24-473c-9e61-ec845ad6e249-kube-api-access-s9wxn\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:30.899566 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf9d252-de24-473c-9e61-ec845ad6e249-serving-cert\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:30.899672 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crbv2\" (UniqueName: \"kubernetes.io/projected/745fe5cc-27ac-4647-a5a3-074547162981-kube-api-access-crbv2\") pod \"network-check-source-7bc5b6bf85-8pzsd\" (UID: \"745fe5cc-27ac-4647-a5a3-074547162981\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" Jul 17 10:01:30.899672 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.899650 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:31.399627891 +0000 UTC m=+48.544204453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:30.899755 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hh9c\" (UniqueName: \"kubernetes.io/projected/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-kube-api-access-2hh9c\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.899790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lml2\" (UniqueName: \"kubernetes.io/projected/01ae2933-affc-47e6-ab26-ab14dbc7e6d9-kube-api-access-9lml2\") pod \"volume-data-source-validator-78cf4c6f6-7qpq8\" (UID: \"01ae2933-affc-47e6-ab26-ab14dbc7e6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" Jul 17 10:01:30.899840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-stats-auth\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.899840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.899825 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.900018 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.899969 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 10:01:30.900018 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:30.900015 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:31.400000677 +0000 UTC m=+48.544577240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : secret "router-metrics-certs-default" not found Jul 17 10:01:30.900207 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.900007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-default-certificate\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.902668 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.902622 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-stats-auth\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.902752 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.902715 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-default-certificate\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.912578 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.912540 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lml2\" (UniqueName: \"kubernetes.io/projected/01ae2933-affc-47e6-ab26-ab14dbc7e6d9-kube-api-access-9lml2\") pod \"volume-data-source-validator-78cf4c6f6-7qpq8\" (UID: \"01ae2933-affc-47e6-ab26-ab14dbc7e6d9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" Jul 17 10:01:30.912880 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.912833 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crbv2\" (UniqueName: \"kubernetes.io/projected/745fe5cc-27ac-4647-a5a3-074547162981-kube-api-access-crbv2\") pod \"network-check-source-7bc5b6bf85-8pzsd\" (UID: \"745fe5cc-27ac-4647-a5a3-074547162981\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" Jul 17 10:01:30.913106 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.913077 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hh9c\" (UniqueName: \"kubernetes.io/projected/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-kube-api-access-2hh9c\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:30.916646 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.916617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:30.942088 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.942066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-ckg48"] Jul 17 10:01:30.944884 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:30.944856 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb706e28_7cc9_4982_88d4_833d3f0f1957.slice/crio-ebe8fec26a4ca1d1dee3e548b9cf09c83719fc6f87a8180f2d38d61b75a72422 WatchSource:0}: Error finding container ebe8fec26a4ca1d1dee3e548b9cf09c83719fc6f87a8180f2d38d61b75a72422: Status 404 returned error can't find the container with id ebe8fec26a4ca1d1dee3e548b9cf09c83719fc6f87a8180f2d38d61b75a72422 Jul 17 10:01:30.948455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.948400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:30.949356 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.949333 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" Jul 17 10:01:30.977977 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:30.976492 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" Jul 17 10:01:31.004621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.002642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d252-de24-473c-9e61-ec845ad6e249-config\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.004621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.002690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9wxn\" (UniqueName: \"kubernetes.io/projected/3bf9d252-de24-473c-9e61-ec845ad6e249-kube-api-access-s9wxn\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.004621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.002714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf9d252-de24-473c-9e61-ec845ad6e249-serving-cert\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.004621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.004226 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bf9d252-de24-473c-9e61-ec845ad6e249-config\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.006839 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.006816 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bf9d252-de24-473c-9e61-ec845ad6e249-serving-cert\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.013934 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.013864 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9wxn\" (UniqueName: \"kubernetes.io/projected/3bf9d252-de24-473c-9e61-ec845ad6e249-kube-api-access-s9wxn\") pod \"service-ca-operator-5bcbc94c78-br886\" (UID: \"3bf9d252-de24-473c-9e61-ec845ad6e249\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.035373 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.034994 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6"] Jul 17 10:01:31.035373 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.035161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" Jul 17 10:01:31.112743 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.112716 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-kjl8j"] Jul 17 10:01:31.116213 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:31.116183 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf070df22_8f07_4e1a_910a_8ece9bca98d3.slice/crio-a5778e927968778dbf1be315930ddb3ebb1908146c195b5dcd66821a7d422e42 WatchSource:0}: Error finding container a5778e927968778dbf1be315930ddb3ebb1908146c195b5dcd66821a7d422e42: Status 404 returned error can't find the container with id a5778e927968778dbf1be315930ddb3ebb1908146c195b5dcd66821a7d422e42 Jul 17 10:01:31.151808 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.151780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8"] Jul 17 10:01:31.155105 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:31.155079 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ae2933_affc_47e6_ab26_ab14dbc7e6d9.slice/crio-f1594b1b6865a48662fb86316b87661c7b3a31f102c2dd12299592d995cdb387 WatchSource:0}: Error finding container f1594b1b6865a48662fb86316b87661c7b3a31f102c2dd12299592d995cdb387: Status 404 returned error can't find the container with id f1594b1b6865a48662fb86316b87661c7b3a31f102c2dd12299592d995cdb387 Jul 17 10:01:31.175867 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:31.175839 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745fe5cc_27ac_4647_a5a3_074547162981.slice/crio-20bd7cf529e949ba5316c56d09e1a0601f64e389469369345d3cd0bc45164778 WatchSource:0}: Error finding container 20bd7cf529e949ba5316c56d09e1a0601f64e389469369345d3cd0bc45164778: Status 404 returned error can't find the container with id 20bd7cf529e949ba5316c56d09e1a0601f64e389469369345d3cd0bc45164778 Jul 17 10:01:31.178920 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.178887 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd"] Jul 17 10:01:31.205149 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.205088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:31.205251 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.205194 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:31.205251 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.205242 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:01:32.20522903 +0000 UTC m=+49.349805577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:31.217722 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.217691 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886"] Jul 17 10:01:31.220537 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:31.220515 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf9d252_de24_473c_9e61_ec845ad6e249.slice/crio-05d424410eeba3b441b6b790930aa4d6e6c646fdbdf23e305a2d2879d4f7e2a5 WatchSource:0}: Error finding container 05d424410eeba3b441b6b790930aa4d6e6c646fdbdf23e305a2d2879d4f7e2a5: Status 404 returned error can't find the container with id 05d424410eeba3b441b6b790930aa4d6e6c646fdbdf23e305a2d2879d4f7e2a5 Jul 17 10:01:31.306110 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.306082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:31.306306 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.306199 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 10:01:31.306306 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.306249 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls podName:c5d2cc07-f182-4962-9afe-c48f66d50244 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:32.306235694 +0000 UTC m=+49.450812242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-scxqf" (UID: "c5d2cc07-f182-4962-9afe-c48f66d50244") : secret "samples-operator-tls" not found Jul 17 10:01:31.406866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.406838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:31.407022 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.406920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:31.407022 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.406993 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 10:01:31.407122 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.407050 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:32.407035641 +0000 UTC m=+49.551612192 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : secret "router-metrics-certs-default" not found Jul 17 10:01:31.407122 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:31.407065 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:32.40705907 +0000 UTC m=+49.551635618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:31.447707 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.447685 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:31.530941 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.530915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:31.710935 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.710883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" event={"ID":"745fe5cc-27ac-4647-a5a3-074547162981","Type":"ContainerStarted","Data":"20bd7cf529e949ba5316c56d09e1a0601f64e389469369345d3cd0bc45164778"} Jul 17 10:01:31.712012 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.711988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" event={"ID":"01ae2933-affc-47e6-ab26-ab14dbc7e6d9","Type":"ContainerStarted","Data":"f1594b1b6865a48662fb86316b87661c7b3a31f102c2dd12299592d995cdb387"} Jul 17 10:01:31.713048 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.713028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" event={"ID":"83df9797-1769-4cb1-9872-8e72f02f039a","Type":"ContainerStarted","Data":"82fd869a10f9837b5206ed0e825eee5c7ca5034c203b2d23a35bdabdd4aa01ab"} Jul 17 10:01:31.714147 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.714125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-ckg48" event={"ID":"fb706e28-7cc9-4982-88d4-833d3f0f1957","Type":"ContainerStarted","Data":"ebe8fec26a4ca1d1dee3e548b9cf09c83719fc6f87a8180f2d38d61b75a72422"} Jul 17 10:01:31.715137 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.715111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" event={"ID":"3bf9d252-de24-473c-9e61-ec845ad6e249","Type":"ContainerStarted","Data":"05d424410eeba3b441b6b790930aa4d6e6c646fdbdf23e305a2d2879d4f7e2a5"} Jul 17 10:01:31.716134 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:31.716113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" event={"ID":"f070df22-8f07-4e1a-910a-8ece9bca98d3","Type":"ContainerStarted","Data":"a5778e927968778dbf1be315930ddb3ebb1908146c195b5dcd66821a7d422e42"} Jul 17 10:01:32.214383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:32.214301 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:32.214564 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.214533 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:32.214626 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.214602 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:01:34.214583984 +0000 UTC m=+51.359160535 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:32.315759 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:32.315722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:32.316067 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.316045 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 10:01:32.316148 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.316108 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls podName:c5d2cc07-f182-4962-9afe-c48f66d50244 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:34.316090734 +0000 UTC m=+51.460667290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-scxqf" (UID: "c5d2cc07-f182-4962-9afe-c48f66d50244") : secret "samples-operator-tls" not found Jul 17 10:01:32.416407 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:32.416371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:32.416565 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:32.416518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:32.416637 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.416559 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:34.416535719 +0000 UTC m=+51.561112270 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:32.416700 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.416636 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 10:01:32.416700 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:32.416689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:34.416673605 +0000 UTC m=+51.561250177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : secret "router-metrics-certs-default" not found Jul 17 10:01:34.235142 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:34.235110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:34.235492 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.235262 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:34.235492 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.235323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.23530727 +0000 UTC m=+55.379883830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:34.336686 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:34.336653 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:34.336875 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.336804 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 10:01:34.336875 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.336868 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls podName:c5d2cc07-f182-4962-9afe-c48f66d50244 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.336854244 +0000 UTC m=+55.481430804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-scxqf" (UID: "c5d2cc07-f182-4962-9afe-c48f66d50244") : secret "samples-operator-tls" not found Jul 17 10:01:34.437233 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:34.437196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:34.437370 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:34.437317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:34.437370 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.437344 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 10:01:34.437475 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.437412 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.437392007 +0000 UTC m=+55.581968557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : secret "router-metrics-certs-default" not found Jul 17 10:01:34.437475 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:34.437470 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.437457123 +0000 UTC m=+55.582033681 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:36.152456 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.152419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.152478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:36.152589 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:36.152612 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5f946b67c6-wjnvb: secret "image-registry-tls" not found Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:36.152651 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:36.152665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls podName:ae9b93bb-6006-44dd-afcf-2f3caa96a0ee nodeName:}" failed. No retries permitted until 2026-07-17 10:01:52.152650281 +0000 UTC m=+69.297226829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls") pod "image-registry-5f946b67c6-wjnvb" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee") : secret "image-registry-tls" not found Jul 17 10:01:36.152927 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:36.152699 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls podName:3d53930c-d6cc-44cc-b1a9-6f2a045e7c82 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:52.15268453 +0000 UTC m=+69.297261082 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls") pod "dns-default-n4l5d" (UID: "3d53930c-d6cc-44cc-b1a9-6f2a045e7c82") : secret "dns-default-metrics-tls" not found Jul 17 10:01:36.732813 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.732776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" event={"ID":"01ae2933-affc-47e6-ab26-ab14dbc7e6d9","Type":"ContainerStarted","Data":"a0d1dc38bd71a6530cedc805a806c80af28e090f80761feed6fbd0bf39bba454"} Jul 17 10:01:36.734445 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.734415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-ckg48" event={"ID":"fb706e28-7cc9-4982-88d4-833d3f0f1957","Type":"ContainerStarted","Data":"79c73914ee743c88c6ee3e79b23e53c2f3db43942b52b44f37c03e7bc196c374"} Jul 17 10:01:36.735947 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.735924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" event={"ID":"3bf9d252-de24-473c-9e61-ec845ad6e249","Type":"ContainerStarted","Data":"7ac7151010617b15be8b2f6cb8bfe6ba35d6cd5e771ada50dfeb4f0a4a14aec5"} Jul 17 10:01:36.737502 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.737485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/0.log" Jul 17 10:01:36.737602 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.737519 2562 generic.go:356] "Generic (PLEG): container finished" podID="f070df22-8f07-4e1a-910a-8ece9bca98d3" containerID="4ad1017ebfe49d060ab37f1b4c8a123b0731d8faaaa95c87ef11fb47c1753bfb" exitCode=255 Jul 17 10:01:36.737602 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.737547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" event={"ID":"f070df22-8f07-4e1a-910a-8ece9bca98d3","Type":"ContainerDied","Data":"4ad1017ebfe49d060ab37f1b4c8a123b0731d8faaaa95c87ef11fb47c1753bfb"} Jul 17 10:01:36.737794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.737780 2562 scope.go:117] "RemoveContainer" containerID="4ad1017ebfe49d060ab37f1b4c8a123b0731d8faaaa95c87ef11fb47c1753bfb" Jul 17 10:01:36.739107 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.739087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" event={"ID":"745fe5cc-27ac-4647-a5a3-074547162981","Type":"ContainerStarted","Data":"8fa8627d73ae6453af0bca8f4406e33fe926d17dcf2dfd5768c093ddadc560ff"} Jul 17 10:01:36.765617 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.765563 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-7qpq8" podStartSLOduration=2.197043317 podStartE2EDuration="6.765545245s" totalImagesPullingTime="4.568501928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:36.764670578 +0000 UTC m=+53.909247149" watchObservedRunningTime="2026-07-17 10:01:36.765545245 +0000 UTC m=+53.910121816" Jul 17 10:01:36.795132 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.795087 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-ckg48" podStartSLOduration=2.010708676 podStartE2EDuration="6.795068218s" totalImagesPullingTime="4.784359542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:36.793662687 +0000 UTC m=+53.938239254" watchObservedRunningTime="2026-07-17 10:01:36.795068218 +0000 UTC m=+53.939644790" Jul 17 10:01:36.894854 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.894807 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" podStartSLOduration=2.383801994 podStartE2EDuration="6.894790565s" totalImagesPullingTime="4.510988571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:36.893971499 +0000 UTC m=+54.038548070" watchObservedRunningTime="2026-07-17 10:01:36.894790565 +0000 UTC m=+54.039367135" Jul 17 10:01:36.948392 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:36.948332 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-8pzsd" podStartSLOduration=2.38132237 podStartE2EDuration="6.948310792s" totalImagesPullingTime="4.566988422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:36.947095362 +0000 UTC m=+54.091671933" watchObservedRunningTime="2026-07-17 10:01:36.948310792 +0000 UTC m=+54.092887368" Jul 17 10:01:37.001452 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.001416 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.080714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.080679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.231348 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.231289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.267833 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.267752 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kfj2r"] Jul 17 10:01:37.272608 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.272586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.275403 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.275378 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 10:01:37.275815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.275665 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sc9p9\"" Jul 17 10:01:37.275815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.275674 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 10:01:37.288286 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.288259 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kfj2r"] Jul 17 10:01:37.311861 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.311828 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.365208 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.365089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.365368 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.365221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9615493-04d1-48bb-adbe-926093f5d24b-data-volume\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.365368 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.365253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.365488 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.365410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9615493-04d1-48bb-adbe-926093f5d24b-crio-socket\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.365488 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.365477 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4pr\" (UniqueName: \"kubernetes.io/projected/b9615493-04d1-48bb-adbe-926093f5d24b-kube-api-access-7s4pr\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466107 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9615493-04d1-48bb-adbe-926093f5d24b-data-volume\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466284 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466284 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.466217 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.466288 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:37.966269153 +0000 UTC m=+55.110845722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : configmap "kube-rbac-proxy" not found Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.466313 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9615493-04d1-48bb-adbe-926093f5d24b-crio-socket\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.466368 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:37.966351435 +0000 UTC m=+55.110928016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : secret "insights-runtime-extractor-tls" not found Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466408 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b9615493-04d1-48bb-adbe-926093f5d24b-crio-socket\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466447 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466434 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4pr\" (UniqueName: \"kubernetes.io/projected/b9615493-04d1-48bb-adbe-926093f5d24b-kube-api-access-7s4pr\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.466717 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.466663 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b9615493-04d1-48bb-adbe-926093f5d24b-data-volume\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.476430 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.476403 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4pr\" (UniqueName: \"kubernetes.io/projected/b9615493-04d1-48bb-adbe-926093f5d24b-kube-api-access-7s4pr\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.688157 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.688119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.743634 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.743603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:01:37.744032 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.744017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/0.log" Jul 17 10:01:37.744097 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.744053 2562 generic.go:356] "Generic (PLEG): container finished" podID="f070df22-8f07-4e1a-910a-8ece9bca98d3" containerID="16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff" exitCode=255 Jul 17 10:01:37.744165 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.744141 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" event={"ID":"f070df22-8f07-4e1a-910a-8ece9bca98d3","Type":"ContainerDied","Data":"16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff"} Jul 17 10:01:37.744252 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.744238 2562 scope.go:117] "RemoveContainer" containerID="4ad1017ebfe49d060ab37f1b4c8a123b0731d8faaaa95c87ef11fb47c1753bfb" Jul 17 10:01:37.744503 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.744489 2562 scope.go:117] "RemoveContainer" containerID="16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff" Jul 17 10:01:37.744701 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.744675 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kjl8j_openshift-console-operator(f070df22-8f07-4e1a-910a-8ece9bca98d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" podUID="f070df22-8f07-4e1a-910a-8ece9bca98d3" Jul 17 10:01:37.745878 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.745850 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" event={"ID":"83df9797-1769-4cb1-9872-8e72f02f039a","Type":"ContainerStarted","Data":"2b4a6855245846b3a1d590ac33ce56e6285ae7688f37929508c21e4f73b6e91e"} Jul 17 10:01:37.771938 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.771893 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.783829 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.783785 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" podStartSLOduration=1.291364459 podStartE2EDuration="7.783767449s" totalImagesPullingTime="6.49240299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:37.783055471 +0000 UTC m=+54.927632041" watchObservedRunningTime="2026-07-17 10:01:37.783767449 +0000 UTC m=+54.928344019" Jul 17 10:01:37.865254 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.865147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:37.973401 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.973367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.973592 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:37.973408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:37.973592 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.973507 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 10:01:37.973592 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.973521 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 10:01:37.973592 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.973581 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.973559725 +0000 UTC m=+56.118136273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : secret "insights-runtime-extractor-tls" not found Jul 17 10:01:37.973592 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:37.973595 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:38.973589159 +0000 UTC m=+56.118165706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : configmap "kube-rbac-proxy" not found Jul 17 10:01:38.276134 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.276095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:38.276500 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.276266 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:38.276500 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.276341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:01:46.276321703 +0000 UTC m=+63.420898256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:38.377277 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.377245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:38.377444 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.377411 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 10:01:38.377531 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.377491 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls podName:c5d2cc07-f182-4962-9afe-c48f66d50244 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:46.377471499 +0000 UTC m=+63.522048050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-scxqf" (UID: "c5d2cc07-f182-4962-9afe-c48f66d50244") : secret "samples-operator-tls" not found Jul 17 10:01:38.441266 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.441236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glgzw_23e88154-8067-47a8-a0df-c4d9d208a3d6/dns-node-resolver/0.log" Jul 17 10:01:38.443919 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.443854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:38.478270 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.478244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:38.478392 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.478377 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:46.478361004 +0000 UTC m=+63.622937555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:38.478459 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.478419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:38.478592 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.478577 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 10:01:38.478642 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.478632 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:01:46.478618133 +0000 UTC m=+63.623194685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : secret "router-metrics-certs-default" not found Jul 17 10:01:38.545095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.545028 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:38.750849 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.750818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:01:38.751213 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.751196 2562 scope.go:117] "RemoveContainer" containerID="16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff" Jul 17 10:01:38.751408 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.751387 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kjl8j_openshift-console-operator(f070df22-8f07-4e1a-910a-8ece9bca98d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" podUID="f070df22-8f07-4e1a-910a-8ece9bca98d3" Jul 17 10:01:38.980957 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.980853 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h"] Jul 17 10:01:38.980957 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.980930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:38.982939 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.982895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:38.983070 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.982972 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 10:01:38.983070 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.982974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:38.983070 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.983026 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:40.983010331 +0000 UTC m=+58.127586899 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : configmap "kube-rbac-proxy" not found Jul 17 10:01:38.983230 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.983076 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 10:01:38.983230 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:38.983117 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:40.983106516 +0000 UTC m=+58.127683073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : secret "insights-runtime-extractor-tls" not found Jul 17 10:01:38.985711 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.985694 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" Jul 17 10:01:38.988223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.988205 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 17 10:01:38.988336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.988207 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wjp5q\"" Jul 17 10:01:38.988336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.988234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 17 10:01:38.994181 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:38.994162 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h"] Jul 17 10:01:39.073501 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.073465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:39.083499 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.083475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wdhm\" (UniqueName: \"kubernetes.io/projected/de9f462a-1e24-4e7e-a30a-bf93abcf9b26-kube-api-access-9wdhm\") pod \"migrator-7cc9c7ffd7-8df9h\" (UID: \"de9f462a-1e24-4e7e-a30a-bf93abcf9b26\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" Jul 17 10:01:39.174468 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.174430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:39.184120 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.184094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wdhm\" (UniqueName: \"kubernetes.io/projected/de9f462a-1e24-4e7e-a30a-bf93abcf9b26-kube-api-access-9wdhm\") pod \"migrator-7cc9c7ffd7-8df9h\" (UID: \"de9f462a-1e24-4e7e-a30a-bf93abcf9b26\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" Jul 17 10:01:39.193216 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.193194 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wdhm\" (UniqueName: \"kubernetes.io/projected/de9f462a-1e24-4e7e-a30a-bf93abcf9b26-kube-api-access-9wdhm\") pod \"migrator-7cc9c7ffd7-8df9h\" (UID: \"de9f462a-1e24-4e7e-a30a-bf93abcf9b26\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" Jul 17 10:01:39.295891 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.295853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" Jul 17 10:01:39.425628 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.425593 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h"] Jul 17 10:01:39.428514 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:39.428485 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9f462a_1e24_4e7e_a30a_bf93abcf9b26.slice/crio-da0e8dcd12cb71cc4449bc920329a090ff36fcaf8d716297f9c3b0e2ae965481 WatchSource:0}: Error finding container da0e8dcd12cb71cc4449bc920329a090ff36fcaf8d716297f9c3b0e2ae965481: Status 404 returned error can't find the container with id da0e8dcd12cb71cc4449bc920329a090ff36fcaf8d716297f9c3b0e2ae965481 Jul 17 10:01:39.430610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.430590 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gppxj"] Jul 17 10:01:39.435867 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.435849 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.438549 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.438525 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 17 10:01:39.438633 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.438534 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 17 10:01:39.438633 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.438536 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 17 10:01:39.438727 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.438608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-rh2k5\"" Jul 17 10:01:39.439346 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.439307 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 17 10:01:39.443663 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.443632 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slzsn_959ad77a-2636-46c5-af86-626f298fe5e3/node-ca/0.log" Jul 17 10:01:39.443790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.443767 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gppxj"] Jul 17 10:01:39.470806 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.470779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:39.486151 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.486125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-key\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.486244 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.486178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skhvf\" (UniqueName: \"kubernetes.io/projected/0c370711-b6d5-47ca-a99e-24e140a4cca3-kube-api-access-skhvf\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.486322 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.486305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-cabundle\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.545324 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.545293 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:39.586999 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.586935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skhvf\" (UniqueName: \"kubernetes.io/projected/0c370711-b6d5-47ca-a99e-24e140a4cca3-kube-api-access-skhvf\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.587126 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.587039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-cabundle\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.587184 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.587168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-key\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.587632 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.587614 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-cabundle\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.589468 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.589450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c370711-b6d5-47ca-a99e-24e140a4cca3-signing-key\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.595316 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.595295 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skhvf\" (UniqueName: \"kubernetes.io/projected/0c370711-b6d5-47ca-a99e-24e140a4cca3-kube-api-access-skhvf\") pod \"service-ca-58598695f7-gppxj\" (UID: \"0c370711-b6d5-47ca-a99e-24e140a4cca3\") " pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.745350 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.745304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gppxj" Jul 17 10:01:39.755824 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.755791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" event={"ID":"de9f462a-1e24-4e7e-a30a-bf93abcf9b26","Type":"ContainerStarted","Data":"da0e8dcd12cb71cc4449bc920329a090ff36fcaf8d716297f9c3b0e2ae965481"} Jul 17 10:01:39.867911 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:39.867875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gppxj"] Jul 17 10:01:39.870051 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:39.870021 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c370711_b6d5_47ca_a99e_24e140a4cca3.slice/crio-fb698e02b5587df7dd13f2128033b2a3f649aa986453969c57f895e16390be74 WatchSource:0}: Error finding container fb698e02b5587df7dd13f2128033b2a3f649aa986453969c57f895e16390be74: Status 404 returned error can't find the container with id fb698e02b5587df7dd13f2128033b2a3f649aa986453969c57f895e16390be74 Jul 17 10:01:40.045293 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.045259 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tf8n7_7ff92ac6-9c9b-40e2-996b-e81bcd14296a/serve-healthcheck-canary/0.log" Jul 17 10:01:40.430328 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.430287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:40.760423 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.760376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" event={"ID":"de9f462a-1e24-4e7e-a30a-bf93abcf9b26","Type":"ContainerStarted","Data":"afc8e7f8448671afbf04bae054b3d71d39698278dc115dec5ec074ffb2084185"} Jul 17 10:01:40.760630 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.760452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" event={"ID":"de9f462a-1e24-4e7e-a30a-bf93abcf9b26","Type":"ContainerStarted","Data":"8970a30199fd232f662e21ca46add8e97ed46d8d84cd239a0fd66ba22d95e3c9"} Jul 17 10:01:40.761866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.761834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gppxj" event={"ID":"0c370711-b6d5-47ca-a99e-24e140a4cca3","Type":"ContainerStarted","Data":"d5d0844f6b82fc6ec02e62c8be48e33cb93feda051b4094e13c540431372fbbd"} Jul 17 10:01:40.761987 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.761872 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gppxj" event={"ID":"0c370711-b6d5-47ca-a99e-24e140a4cca3","Type":"ContainerStarted","Data":"fb698e02b5587df7dd13f2128033b2a3f649aa986453969c57f895e16390be74"} Jul 17 10:01:40.849854 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.849801 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-8df9h" podStartSLOduration=1.707914067 podStartE2EDuration="2.849782795s" totalImagesPullingTime="1.141868728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:40.810185439 +0000 UTC m=+57.954762009" watchObservedRunningTime="2026-07-17 10:01:40.849782795 +0000 UTC m=+57.994359364" Jul 17 10:01:40.850392 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.850365 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gppxj" podStartSLOduration=1.8503577039999999 podStartE2EDuration="1.850357704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:40.849443768 +0000 UTC m=+57.994020339" watchObservedRunningTime="2026-07-17 10:01:40.850357704 +0000 UTC m=+57.994934274" Jul 17 10:01:40.916953 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.916922 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:40.917112 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.916978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:40.917339 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.917328 2562 scope.go:117] "RemoveContainer" containerID="16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff" Jul 17 10:01:40.917483 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:40.917466 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-kjl8j_openshift-console-operator(f070df22-8f07-4e1a-910a-8ece9bca98d3)\"" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" podUID="f070df22-8f07-4e1a-910a-8ece9bca98d3" Jul 17 10:01:40.999710 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.999668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:40.999875 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:40.999738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:40.999875 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:40.999797 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 10:01:40.999875 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:40.999846 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:44.999831636 +0000 UTC m=+62.144408187 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : configmap "kube-rbac-proxy" not found Jul 17 10:01:41.000068 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:40.999934 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 10:01:41.000068 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:41.000002 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:44.999983935 +0000 UTC m=+62.144560490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : secret "insights-runtime-extractor-tls" not found Jul 17 10:01:41.624230 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:41.624170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:41.868605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:41.868565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:41.971891 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:41.971791 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:42.168214 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:42.168169 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:42.287426 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:42.287385 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:42.371689 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:42.371650 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:43.127523 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:43.127470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:43.514825 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:43.514784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:43.924586 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:43.924485 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:44.322230 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:44.322196 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:44.665317 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:44.665239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ggs5j" Jul 17 10:01:45.041548 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:45.041509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:45.041732 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:45.041558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:45.041732 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:45.041629 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 10:01:45.041732 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:45.041642 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 10:01:45.041732 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:45.041694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:53.041678085 +0000 UTC m=+70.186254633 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : configmap "kube-rbac-proxy" not found Jul 17 10:01:45.041732 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:45.041714 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls podName:b9615493-04d1-48bb-adbe-926093f5d24b nodeName:}" failed. No retries permitted until 2026-07-17 10:01:53.041707556 +0000 UTC m=+70.186284103 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kfj2r" (UID: "b9615493-04d1-48bb-adbe-926093f5d24b") : secret "insights-runtime-extractor-tls" not found Jul 17 10:01:46.354006 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.353974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:01:46.354361 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:46.354116 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:46.354361 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:46.354187 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls podName:2c6b65b3-a081-49bc-8f6b-ba46bff55fba nodeName:}" failed. No retries permitted until 2026-07-17 10:02:02.354170461 +0000 UTC m=+79.498747015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-sf2v5" (UID: "2c6b65b3-a081-49bc-8f6b-ba46bff55fba") : secret "cluster-monitoring-operator-tls" not found Jul 17 10:01:46.454747 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.454709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:46.457163 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.457123 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5d2cc07-f182-4962-9afe-c48f66d50244-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-scxqf\" (UID: \"c5d2cc07-f182-4962-9afe-c48f66d50244\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:46.496037 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.496009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b8hnx\"" Jul 17 10:01:46.503305 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.503281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" Jul 17 10:01:46.556090 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.556045 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:46.556279 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.556189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:46.556342 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:01:46.556334 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle podName:2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5 nodeName:}" failed. No retries permitted until 2026-07-17 10:02:02.556315592 +0000 UTC m=+79.700892140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle") pod "router-default-696d6cd74-glp2h" (UID: "2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5") : configmap references non-existent config key: service-ca.crt Jul 17 10:01:46.558514 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.558486 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-metrics-certs\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:01:46.648706 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.648613 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf"] Jul 17 10:01:46.784435 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:46.784394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" event={"ID":"c5d2cc07-f182-4962-9afe-c48f66d50244","Type":"ContainerStarted","Data":"87463fca92c2e47b712b39bad7fa1cd019a07a435a9e0a1f884c58b34057a4e1"} Jul 17 10:01:47.804833 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:47.804790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:47.966083 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:47.966039 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.183023 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.182940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.420775 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.420734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.549035 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.549006 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.660514 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.660474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.756812 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.756777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:48.944975 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:48.944872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:49.330543 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:49.330508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:49.947121 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:49.947085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:50.189955 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.189919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:50.192848 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.192831 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 10:01:50.202534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.202478 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/87465486-5c8f-454b-9324-7aed59e1e416-metrics-certs\") pod \"network-metrics-daemon-9z2cv\" (UID: \"87465486-5c8f-454b-9324-7aed59e1e416\") " pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:50.291418 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.291374 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:50.295513 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.295485 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 10:01:50.305055 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.305033 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f036d05-90c6-482a-9ce5-93576c140616-original-pull-secret\") pod \"global-pull-secret-syncer-klfz9\" (UID: \"7f036d05-90c6-482a-9ce5-93576c140616\") " pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:50.364026 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.363994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8mmk8\"" Jul 17 10:01:50.368429 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.368407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-klfz9" Jul 17 10:01:50.371117 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.371042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z2cv" Jul 17 10:01:50.392037 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.391995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:50.395293 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.395268 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r76jc\" (UniqueName: \"kubernetes.io/projected/32b5041f-7636-49c6-9306-5f90606cae58-kube-api-access-r76jc\") pod \"network-check-target-z6cm7\" (UID: \"32b5041f-7636-49c6-9306-5f90606cae58\") " pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:50.522968 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.522611 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-klfz9"] Jul 17 10:01:50.525139 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:50.525112 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f036d05_90c6_482a_9ce5_93576c140616.slice/crio-76f925c12f71de13b70339c8341d931ea4e13e9bd6abb3f71b5fa93e7afa387a WatchSource:0}: Error finding container 76f925c12f71de13b70339c8341d931ea4e13e9bd6abb3f71b5fa93e7afa387a: Status 404 returned error can't find the container with id 76f925c12f71de13b70339c8341d931ea4e13e9bd6abb3f71b5fa93e7afa387a Jul 17 10:01:50.550770 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.550743 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9z2cv"] Jul 17 10:01:50.552916 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:50.552874 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87465486_5c8f_454b_9324_7aed59e1e416.slice/crio-c84743eba984cd038d7d3e2f29ca42dbbe52a654290e84d62768e6b380db82b7 WatchSource:0}: Error finding container c84743eba984cd038d7d3e2f29ca42dbbe52a654290e84d62768e6b380db82b7: Status 404 returned error can't find the container with id c84743eba984cd038d7d3e2f29ca42dbbe52a654290e84d62768e6b380db82b7 Jul 17 10:01:50.559885 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.559858 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:50.647097 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.647058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:50.667641 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.667616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d2zq6\"" Jul 17 10:01:50.675792 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.675767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:50.760095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.760045 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:50.800757 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.800719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z2cv" event={"ID":"87465486-5c8f-454b-9324-7aed59e1e416","Type":"ContainerStarted","Data":"c84743eba984cd038d7d3e2f29ca42dbbe52a654290e84d62768e6b380db82b7"} Jul 17 10:01:50.802354 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.802280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klfz9" event={"ID":"7f036d05-90c6-482a-9ce5-93576c140616","Type":"ContainerStarted","Data":"76f925c12f71de13b70339c8341d931ea4e13e9bd6abb3f71b5fa93e7afa387a"} Jul 17 10:01:50.827079 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:50.826931 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6cm7"] Jul 17 10:01:50.830053 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:50.830018 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b5041f_7636_49c6_9306_5f90606cae58.slice/crio-41d571f7159fb34b21d1eba36a87f57d2cfddbf7a838eff6b3b82dfebdd685d5 WatchSource:0}: Error finding container 41d571f7159fb34b21d1eba36a87f57d2cfddbf7a838eff6b3b82dfebdd685d5: Status 404 returned error can't find the container with id 41d571f7159fb34b21d1eba36a87f57d2cfddbf7a838eff6b3b82dfebdd685d5 Jul 17 10:01:51.808551 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:51.808507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6cm7" event={"ID":"32b5041f-7636-49c6-9306-5f90606cae58","Type":"ContainerStarted","Data":"b6f88956fb6cbc65940ec565a5772a8d1ca4ea4dd6861ecc7754596bc8ec8c07"} Jul 17 10:01:51.809094 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:51.808572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6cm7" event={"ID":"32b5041f-7636-49c6-9306-5f90606cae58","Type":"ContainerStarted","Data":"41d571f7159fb34b21d1eba36a87f57d2cfddbf7a838eff6b3b82dfebdd685d5"} Jul 17 10:01:51.809094 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:51.808778 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:01:51.836429 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:51.836366 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6cm7" podStartSLOduration=67.836340702 podStartE2EDuration="1m7.836340702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:51.834818316 +0000 UTC m=+68.979394886" watchObservedRunningTime="2026-07-17 10:01:51.836340702 +0000 UTC m=+68.980917274" Jul 17 10:01:52.211996 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.211963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:52.212185 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.212010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:52.214569 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.214522 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3d53930c-d6cc-44cc-b1a9-6f2a045e7c82-metrics-tls\") pod \"dns-default-n4l5d\" (UID: \"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82\") " pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:52.215081 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.215044 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"image-registry-5f946b67c6-wjnvb\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:52.378172 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.378090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dl28k\"" Jul 17 10:01:52.385700 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.385673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:52.394155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.394130 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vz6sd\"" Jul 17 10:01:52.402449 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.402419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:52.575139 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.575088 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:01:52.578220 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:52.578186 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9b93bb_6006_44dd_afcf_2f3caa96a0ee.slice/crio-5e6435fba2453997186ea037cd8801ad99b6cb73dd842326b8957becae34bbb9 WatchSource:0}: Error finding container 5e6435fba2453997186ea037cd8801ad99b6cb73dd842326b8957becae34bbb9: Status 404 returned error can't find the container with id 5e6435fba2453997186ea037cd8801ad99b6cb73dd842326b8957becae34bbb9 Jul 17 10:01:52.580347 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.580321 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4l5d"] Jul 17 10:01:52.584200 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:52.584174 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d53930c_d6cc_44cc_b1a9_6f2a045e7c82.slice/crio-0a5f0d3dcb7c4f3ff3f6c64d6cfda71596c9620c4af9864716293c55ce2c25a8 WatchSource:0}: Error finding container 0a5f0d3dcb7c4f3ff3f6c64d6cfda71596c9620c4af9864716293c55ce2c25a8: Status 404 returned error can't find the container with id 0a5f0d3dcb7c4f3ff3f6c64d6cfda71596c9620c4af9864716293c55ce2c25a8 Jul 17 10:01:52.814646 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.814607 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4l5d" event={"ID":"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82","Type":"ContainerStarted","Data":"0a5f0d3dcb7c4f3ff3f6c64d6cfda71596c9620c4af9864716293c55ce2c25a8"} Jul 17 10:01:52.816790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.816747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" event={"ID":"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee","Type":"ContainerStarted","Data":"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5"} Jul 17 10:01:52.816951 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.816799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" event={"ID":"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee","Type":"ContainerStarted","Data":"5e6435fba2453997186ea037cd8801ad99b6cb73dd842326b8957becae34bbb9"} Jul 17 10:01:52.816951 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.816885 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:01:52.819065 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.819038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z2cv" event={"ID":"87465486-5c8f-454b-9324-7aed59e1e416","Type":"ContainerStarted","Data":"78625e7d27b18614567ed6c925be5a159e6b22c5644946851059ae9478dafe0d"} Jul 17 10:01:52.819196 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.819090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z2cv" event={"ID":"87465486-5c8f-454b-9324-7aed59e1e416","Type":"ContainerStarted","Data":"c6a16123de52c7d62a9e2c84c20618cd5caaea27fcf08e2e274cecca5262f798"} Jul 17 10:01:52.821304 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.821276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" event={"ID":"c5d2cc07-f182-4962-9afe-c48f66d50244","Type":"ContainerStarted","Data":"8c09d0675d64f896330fc87e368aee493331b86abcbfa94ad37ce5f07ff73700"} Jul 17 10:01:52.821421 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.821329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" event={"ID":"c5d2cc07-f182-4962-9afe-c48f66d50244","Type":"ContainerStarted","Data":"624c7c250640ba4b97c2daaa7fe5b2d18f007fac1b2cc6ba594b6fbf977d425f"} Jul 17 10:01:52.872564 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.872437 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" podStartSLOduration=67.872418614 podStartE2EDuration="1m7.872418614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:52.847640019 +0000 UTC m=+69.992216589" watchObservedRunningTime="2026-07-17 10:01:52.872418614 +0000 UTC m=+70.016995182" Jul 17 10:01:52.873118 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.873025 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9z2cv" podStartSLOduration=67.450374704 podStartE2EDuration="1m8.873010582s" totalImagesPullingTime="1.422635878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:52.87218452 +0000 UTC m=+70.016761091" watchObservedRunningTime="2026-07-17 10:01:52.873010582 +0000 UTC m=+70.017587144" Jul 17 10:01:52.899748 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:52.899691 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-scxqf" podStartSLOduration=17.62687552 podStartE2EDuration="22.899669179s" totalImagesPullingTime="5.272793659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:52.898624631 +0000 UTC m=+70.043201203" watchObservedRunningTime="2026-07-17 10:01:52.899669179 +0000 UTC m=+70.044245748" Jul 17 10:01:53.122022 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.121985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:53.122204 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.122043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:53.122666 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.122607 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b9615493-04d1-48bb-adbe-926093f5d24b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:53.124927 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.124878 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b9615493-04d1-48bb-adbe-926093f5d24b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kfj2r\" (UID: \"b9615493-04d1-48bb-adbe-926093f5d24b\") " pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:53.187791 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.187711 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sc9p9\"" Jul 17 10:01:53.195509 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.195282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kfj2r" Jul 17 10:01:53.367842 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.367696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kfj2r"] Jul 17 10:01:53.370414 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:01:53.370382 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9615493_04d1_48bb_adbe_926093f5d24b.slice/crio-5b3efcf9b24e90e09267a5c76c63a893dfe21a53c0468c206452413e24c3e381 WatchSource:0}: Error finding container 5b3efcf9b24e90e09267a5c76c63a893dfe21a53c0468c206452413e24c3e381: Status 404 returned error can't find the container with id 5b3efcf9b24e90e09267a5c76c63a893dfe21a53c0468c206452413e24c3e381 Jul 17 10:01:53.826548 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.826510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfj2r" event={"ID":"b9615493-04d1-48bb-adbe-926093f5d24b","Type":"ContainerStarted","Data":"5b3efcf9b24e90e09267a5c76c63a893dfe21a53c0468c206452413e24c3e381"} Jul 17 10:01:53.856368 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.856335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:53.955144 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:53.955100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:54.541977 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:54.541950 2562 scope.go:117] "RemoveContainer" containerID="16a33476a56ee9c652f84da55892eefd28c4dbaa6fbef18517bb04943bb2b5ff" Jul 17 10:01:55.837714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.837484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4l5d" event={"ID":"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82","Type":"ContainerStarted","Data":"b4054c8a0f10bc799d1d3b14ce86305b8d6eae82642289febbca4931a15ad6d5"} Jul 17 10:01:55.837714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.837550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4l5d" event={"ID":"3d53930c-d6cc-44cc-b1a9-6f2a045e7c82","Type":"ContainerStarted","Data":"1d4dc268d00f00b058b2cace7daa7ed827f6b3664ae0515f3efba1d5f662061a"} Jul 17 10:01:55.837714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.837715 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4l5d" Jul 17 10:01:55.839623 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.839597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-klfz9" event={"ID":"7f036d05-90c6-482a-9ce5-93576c140616","Type":"ContainerStarted","Data":"bb46345483e1b7e6b766a366528887e1c54c5f3a42e9412a383fc578d696937f"} Jul 17 10:01:55.843450 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.843429 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:01:55.843562 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.843478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" event={"ID":"f070df22-8f07-4e1a-910a-8ece9bca98d3","Type":"ContainerStarted","Data":"0f558ed48ef78ea22b0dc222f09a7ce205a01654e1edcccaa57857dab93fe7c3"} Jul 17 10:01:55.844277 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.843963 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:55.858165 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.858124 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4l5d" podStartSLOduration=32.875189569 podStartE2EDuration="35.858110999s" totalImagesPullingTime="2.98292143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:55.857027835 +0000 UTC m=+73.001604410" watchObservedRunningTime="2026-07-17 10:01:55.858110999 +0000 UTC m=+73.002687569" Jul 17 10:01:55.874222 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.874171 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-klfz9" podStartSLOduration=66.827496507 podStartE2EDuration="1m11.874153981s" totalImagesPullingTime="5.046657474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:55.872871923 +0000 UTC m=+73.017448507" watchObservedRunningTime="2026-07-17 10:01:55.874153981 +0000 UTC m=+73.018730552" Jul 17 10:01:55.892267 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:55.892217 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" podStartSLOduration=21.275929275 podStartE2EDuration="25.892204897s" totalImagesPullingTime="4.616275622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:01:55.892100002 +0000 UTC m=+73.036676573" watchObservedRunningTime="2026-07-17 10:01:55.892204897 +0000 UTC m=+73.036781469" Jul 17 10:01:56.179596 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:56.179501 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-kjl8j" Jul 17 10:01:56.384585 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:56.384522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:56.484389 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:56.484295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:56.553347 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:56.553314 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:56.679047 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:56.679012 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.052368 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.052328 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.114791 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.114752 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.246036 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.245981 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.323397 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.323311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.464587 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.464557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:57.942322 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:57.942277 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.095321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.095251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.209559 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.209480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.550478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.550431 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v"] Jul 17 10:01:58.599117 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.599086 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm"] Jul 17 10:01:58.599328 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.599304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.602611 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.602584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 10:01:58.602882 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.602863 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7dbf9\"" Jul 17 10:01:58.603024 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.602959 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 10:01:58.603024 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.602976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 10:01:58.603638 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.603618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 10:01:58.622214 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.622192 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm"] Jul 17 10:01:58.623124 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.623102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.626460 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.626431 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 17 10:01:58.626629 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.626609 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 17 10:01:58.626702 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.626686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 17 10:01:58.632730 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.631106 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 17 10:01:58.654943 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.654885 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s"] Jul 17 10:01:58.655095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.655071 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.658276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.658084 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 17 10:01:58.658276 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.658090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-c9mnj\"" Jul 17 10:01:58.658438 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.658398 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 17 10:01:58.667868 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.667841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/968c3f55-c80d-4e2f-8bce-9ee3fb769425-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.667992 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.667925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8vxd\" (UniqueName: \"kubernetes.io/projected/968c3f55-c80d-4e2f-8bce-9ee3fb769425-kube-api-access-m8vxd\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.685212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.685071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm"] Jul 17 10:01:58.685212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.685114 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v"] Jul 17 10:01:58.685212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.685133 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm"] Jul 17 10:01:58.685212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.685153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s"] Jul 17 10:01:58.685212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.685210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.688068 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.688046 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 10:01:58.699142 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.699070 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.700200 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.700180 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-zwbvr"] Jul 17 10:01:58.734508 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.734457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-zwbvr"] Jul 17 10:01:58.734658 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.734531 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:01:58.739484 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.739465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 17 10:01:58.739861 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.739844 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-t98gp\"" Jul 17 10:01:58.740102 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.740086 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 17 10:01:58.768518 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/047cbacf-41f0-4767-8b8b-56e73e42db18-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.768622 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.768622 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/047cbacf-41f0-4767-8b8b-56e73e42db18-tmp\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.768622 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.768794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8vxd\" (UniqueName: \"kubernetes.io/projected/968c3f55-c80d-4e2f-8bce-9ee3fb769425-kube-api-access-m8vxd\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.768794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.768794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768692 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4kk8\" (UniqueName: \"kubernetes.io/projected/047cbacf-41f0-4767-8b8b-56e73e42db18-kube-api-access-w4kk8\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.768794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dv6f\" (UniqueName: \"kubernetes.io/projected/a00bf482-3bfd-4252-9645-c9454c7c774d-kube-api-access-2dv6f\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.768794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.769056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.769056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.769056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00bf482-3bfd-4252-9645-c9454c7c774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.769056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.768945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/968c3f55-c80d-4e2f-8bce-9ee3fb769425-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.771955 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.771931 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/968c3f55-c80d-4e2f-8bce-9ee3fb769425-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.789344 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.786592 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8vxd\" (UniqueName: \"kubernetes.io/projected/968c3f55-c80d-4e2f-8bce-9ee3fb769425-kube-api-access-m8vxd\") pod \"managed-serviceaccount-addon-agent-659cf4bf8-66v4v\" (UID: \"968c3f55-c80d-4e2f-8bce-9ee3fb769425\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.811857 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.811578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.869782 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.869965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/047cbacf-41f0-4767-8b8b-56e73e42db18-tmp\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.869965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.869965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.869965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4kk8\" (UniqueName: \"kubernetes.io/projected/047cbacf-41f0-4767-8b8b-56e73e42db18-kube-api-access-w4kk8\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.869965 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.869959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dv6f\" (UniqueName: \"kubernetes.io/projected/a00bf482-3bfd-4252-9645-c9454c7c774d-kube-api-access-2dv6f\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zjq6\" (UniqueName: \"kubernetes.io/projected/cb81f3aa-c45c-4a69-bac8-8f768de18821-kube-api-access-4zjq6\") pod \"downloads-5bc67dcd46-zwbvr\" (UID: \"cb81f3aa-c45c-4a69-bac8-8f768de18821\") " pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00bf482-3bfd-4252-9645-c9454c7c774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.870240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/047cbacf-41f0-4767-8b8b-56e73e42db18-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.870533 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.870279 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/047cbacf-41f0-4767-8b8b-56e73e42db18-tmp\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.871026 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.871002 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.871129 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.871087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a00bf482-3bfd-4252-9645-c9454c7c774d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.873891 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.873516 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/165de07f-d6cd-43d9-bb10-a1b5601ac6bd-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-9bcvm\" (UID: \"165de07f-d6cd-43d9-bb10-a1b5601ac6bd\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.874082 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.873816 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.874082 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.873883 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-hub\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.874517 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.874476 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.874916 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.874875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a00bf482-3bfd-4252-9645-c9454c7c774d-ca\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.875021 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.875000 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/047cbacf-41f0-4767-8b8b-56e73e42db18-klusterlet-config\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.884586 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.884565 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dv6f\" (UniqueName: \"kubernetes.io/projected/a00bf482-3bfd-4252-9645-c9454c7c774d-kube-api-access-2dv6f\") pod \"cluster-proxy-proxy-agent-78784b8444-lrspm\" (UID: \"a00bf482-3bfd-4252-9645-c9454c7c774d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.884671 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.884583 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4kk8\" (UniqueName: \"kubernetes.io/projected/047cbacf-41f0-4767-8b8b-56e73e42db18-kube-api-access-w4kk8\") pod \"klusterlet-addon-workmgr-6d48df75f4-wzh9s\" (UID: \"047cbacf-41f0-4767-8b8b-56e73e42db18\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:58.904743 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.904718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:58.922845 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.922823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" Jul 17 10:01:58.936048 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.936027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" Jul 17 10:01:58.971065 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.971037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zjq6\" (UniqueName: \"kubernetes.io/projected/cb81f3aa-c45c-4a69-bac8-8f768de18821-kube-api-access-4zjq6\") pod \"downloads-5bc67dcd46-zwbvr\" (UID: \"cb81f3aa-c45c-4a69-bac8-8f768de18821\") " pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:01:58.971859 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.971832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" Jul 17 10:01:58.980788 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.980768 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zjq6\" (UniqueName: \"kubernetes.io/projected/cb81f3aa-c45c-4a69-bac8-8f768de18821-kube-api-access-4zjq6\") pod \"downloads-5bc67dcd46-zwbvr\" (UID: \"cb81f3aa-c45c-4a69-bac8-8f768de18821\") " pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:01:58.996947 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:58.996917 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:01:59.012671 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.012636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:59.046606 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.046585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:01:59.113740 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.113710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:59.210866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.210831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:59.307725 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.307691 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:01:59.390328 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:01:59.390234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:00.042076 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.042013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:00.140001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.139966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:00.748210 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.747831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s"] Jul 17 10:02:00.751919 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:00.751868 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047cbacf_41f0_4767_8b8b_56e73e42db18.slice/crio-0d52e2f73032cb5a14362ed87d5f9606d417359de34b940c0d0e305f371b7be5 WatchSource:0}: Error finding container 0d52e2f73032cb5a14362ed87d5f9606d417359de34b940c0d0e305f371b7be5: Status 404 returned error can't find the container with id 0d52e2f73032cb5a14362ed87d5f9606d417359de34b940c0d0e305f371b7be5 Jul 17 10:02:00.788305 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.788284 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm"] Jul 17 10:02:00.789528 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:00.789502 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda00bf482_3bfd_4252_9645_c9454c7c774d.slice/crio-f7e65db50fcf87419276be7896182086fbffa79b8a80742bbe1c341f408f8403 WatchSource:0}: Error finding container f7e65db50fcf87419276be7896182086fbffa79b8a80742bbe1c341f408f8403: Status 404 returned error can't find the container with id f7e65db50fcf87419276be7896182086fbffa79b8a80742bbe1c341f408f8403 Jul 17 10:02:00.829126 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.829068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:00.870184 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.870158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfj2r" event={"ID":"b9615493-04d1-48bb-adbe-926093f5d24b","Type":"ContainerStarted","Data":"6bea2983a9dcca605135617fe6e399c136d52d6c56673f371d9642bb31d8a2b4"} Jul 17 10:02:00.871267 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.871246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" event={"ID":"047cbacf-41f0-4767-8b8b-56e73e42db18","Type":"ContainerStarted","Data":"0d52e2f73032cb5a14362ed87d5f9606d417359de34b940c0d0e305f371b7be5"} Jul 17 10:02:00.872335 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.872312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" event={"ID":"a00bf482-3bfd-4252-9645-c9454c7c774d","Type":"ContainerStarted","Data":"f7e65db50fcf87419276be7896182086fbffa79b8a80742bbe1c341f408f8403"} Jul 17 10:02:00.922866 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:00.922845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:01.006607 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.006539 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v"] Jul 17 10:02:01.007738 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:01.007709 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb81f3aa_c45c_4a69_bac8_8f768de18821.slice/crio-88314f36441198ac891767b0308892711fd9880244a993460c7b2dafd0419a55 WatchSource:0}: Error finding container 88314f36441198ac891767b0308892711fd9880244a993460c7b2dafd0419a55: Status 404 returned error can't find the container with id 88314f36441198ac891767b0308892711fd9880244a993460c7b2dafd0419a55 Jul 17 10:02:01.008113 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.008087 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm"] Jul 17 10:02:01.009029 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:01.009004 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod968c3f55_c80d_4e2f_8bce_9ee3fb769425.slice/crio-d25a07a7b553e247783d09ec70e80ea512e44df42a033c7f7b4c1f14c473709b WatchSource:0}: Error finding container d25a07a7b553e247783d09ec70e80ea512e44df42a033c7f7b4c1f14c473709b: Status 404 returned error can't find the container with id d25a07a7b553e247783d09ec70e80ea512e44df42a033c7f7b4c1f14c473709b Jul 17 10:02:01.009461 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.009438 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-zwbvr"] Jul 17 10:02:01.009790 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:01.009724 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165de07f_d6cd_43d9_bb10_a1b5601ac6bd.slice/crio-cfd8de3d8f747c3e5615bfd1b31fdd54733353e4ded32258e035241c9f4e84a4 WatchSource:0}: Error finding container cfd8de3d8f747c3e5615bfd1b31fdd54733353e4ded32258e035241c9f4e84a4: Status 404 returned error can't find the container with id cfd8de3d8f747c3e5615bfd1b31fdd54733353e4ded32258e035241c9f4e84a4 Jul 17 10:02:01.882957 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.882846 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-zwbvr" event={"ID":"cb81f3aa-c45c-4a69-bac8-8f768de18821","Type":"ContainerStarted","Data":"88314f36441198ac891767b0308892711fd9880244a993460c7b2dafd0419a55"} Jul 17 10:02:01.885396 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.885310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" event={"ID":"165de07f-d6cd-43d9-bb10-a1b5601ac6bd","Type":"ContainerStarted","Data":"cfd8de3d8f747c3e5615bfd1b31fdd54733353e4ded32258e035241c9f4e84a4"} Jul 17 10:02:01.887570 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:01.887530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" event={"ID":"968c3f55-c80d-4e2f-8bce-9ee3fb769425","Type":"ContainerStarted","Data":"d25a07a7b553e247783d09ec70e80ea512e44df42a033c7f7b4c1f14c473709b"} Jul 17 10:02:02.403297 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.402762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:02:02.410141 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.410086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2c6b65b3-a081-49bc-8f6b-ba46bff55fba-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-sf2v5\" (UID: \"2c6b65b3-a081-49bc-8f6b-ba46bff55fba\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:02:02.584288 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.584029 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-pxqs6\"" Jul 17 10:02:02.591223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.591031 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" Jul 17 10:02:02.605675 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.604960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:02.605675 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.605626 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5-service-ca-bundle\") pod \"router-default-696d6cd74-glp2h\" (UID: \"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5\") " pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:02.734347 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.734258 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-n6x6j\"" Jul 17 10:02:02.742479 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:02.742457 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:05.162838 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:05.162788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:05.261946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:05.261888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:05.855666 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:05.854932 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4l5d" Jul 17 10:02:08.057262 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:08.057089 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-696d6cd74-glp2h"] Jul 17 10:02:08.418688 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:08.418652 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:08.522878 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:08.522840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:10.375180 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:10.375132 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b88bd16_9252_4e04_ae4b_78ac2bc7cfd5.slice/crio-a6167616fbb5e2c9d3aab15cd97085e086ad2217cdcfb4bbe326c03941baa9d5 WatchSource:0}: Error finding container a6167616fbb5e2c9d3aab15cd97085e086ad2217cdcfb4bbe326c03941baa9d5: Status 404 returned error can't find the container with id a6167616fbb5e2c9d3aab15cd97085e086ad2217cdcfb4bbe326c03941baa9d5 Jul 17 10:02:10.678763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:10.678686 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5"] Jul 17 10:02:10.804939 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:10.804887 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6b65b3_a081_49bc_8f6b_ba46bff55fba.slice/crio-ebe38adc5192fb9b85a86f3e3e8fba308a40cddba259ba17512f2be059e3e733 WatchSource:0}: Error finding container ebe38adc5192fb9b85a86f3e3e8fba308a40cddba259ba17512f2be059e3e733: Status 404 returned error can't find the container with id ebe38adc5192fb9b85a86f3e3e8fba308a40cddba259ba17512f2be059e3e733 Jul 17 10:02:10.937671 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:10.937600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" event={"ID":"2c6b65b3-a081-49bc-8f6b-ba46bff55fba","Type":"ContainerStarted","Data":"ebe38adc5192fb9b85a86f3e3e8fba308a40cddba259ba17512f2be059e3e733"} Jul 17 10:02:10.938892 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:10.938865 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-696d6cd74-glp2h" event={"ID":"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5","Type":"ContainerStarted","Data":"a6167616fbb5e2c9d3aab15cd97085e086ad2217cdcfb4bbe326c03941baa9d5"} Jul 17 10:02:10.992586 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:10.992500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:11.093717 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.093667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:11.950222 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.949669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" event={"ID":"968c3f55-c80d-4e2f-8bce-9ee3fb769425","Type":"ContainerStarted","Data":"97ca2f0306a4486678e0385e3851c990e2999f3891d4602f13171550fdfde12e"} Jul 17 10:02:11.952712 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.952630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfj2r" event={"ID":"b9615493-04d1-48bb-adbe-926093f5d24b","Type":"ContainerStarted","Data":"7ee32afd8b363d18c702c49c38b52e28a0d23503c84ae15b7088123d164a9718"} Jul 17 10:02:11.955368 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.955317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" event={"ID":"047cbacf-41f0-4767-8b8b-56e73e42db18","Type":"ContainerStarted","Data":"3771b58c08bae6f3ff26f6b5e25f878951dbc724227753f76ed16fa92b163ddf"} Jul 17 10:02:11.955789 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.955703 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:02:11.957860 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.957842 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" Jul 17 10:02:11.958056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.958028 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-696d6cd74-glp2h" event={"ID":"2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5","Type":"ContainerStarted","Data":"e18d80519223a8617b56d149a2b6581fffef851e3d89d4f123aee903dab3c9c5"} Jul 17 10:02:11.960721 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.960697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" event={"ID":"165de07f-d6cd-43d9-bb10-a1b5601ac6bd","Type":"ContainerStarted","Data":"0baf47080a806d70b9c84938052ee7edad9c7c1bd7b00c6b3d0b89cf17409e17"} Jul 17 10:02:11.964015 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.963992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" event={"ID":"a00bf482-3bfd-4252-9645-c9454c7c774d","Type":"ContainerStarted","Data":"a8dc0c63ffcaa97dabde8c415483d9dc380d1ab4472811ec23d12beb4653e57b"} Jul 17 10:02:11.964120 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.964030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" event={"ID":"a00bf482-3bfd-4252-9645-c9454c7c774d","Type":"ContainerStarted","Data":"fa88e6a87ebc5200685848304143dafd0cbddc328a4863898463d18e2ee31054"} Jul 17 10:02:11.964120 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.964048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" event={"ID":"a00bf482-3bfd-4252-9645-c9454c7c774d","Type":"ContainerStarted","Data":"441cf15014bc79014b3310b8aa156d08779a9455b4c71e92233a585aad199759"} Jul 17 10:02:11.970607 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.970108 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-659cf4bf8-66v4v" podStartSLOduration=4.025407187 podStartE2EDuration="13.970093864s" totalImagesPullingTime="9.944686677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:11.969199712 +0000 UTC m=+89.113776280" watchObservedRunningTime="2026-07-17 10:02:11.970093864 +0000 UTC m=+89.114670434" Jul 17 10:02:11.988946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:11.988884 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-9bcvm" podStartSLOduration=4.46176132 podStartE2EDuration="13.988867314s" totalImagesPullingTime="9.527105994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:11.988350959 +0000 UTC m=+89.132927530" watchObservedRunningTime="2026-07-17 10:02:11.988867314 +0000 UTC m=+89.133443865" Jul 17 10:02:12.011190 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.010046 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78784b8444-lrspm" podStartSLOduration=3.845884932 podStartE2EDuration="14.010027913s" totalImagesPullingTime="10.164142981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:12.008882124 +0000 UTC m=+89.153458695" watchObservedRunningTime="2026-07-17 10:02:12.010027913 +0000 UTC m=+89.154604485" Jul 17 10:02:12.059415 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.058427 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-696d6cd74-glp2h" podStartSLOduration=42.058408774 podStartE2EDuration="42.058408774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:12.037714535 +0000 UTC m=+89.182291106" watchObservedRunningTime="2026-07-17 10:02:12.058408774 +0000 UTC m=+89.202985346" Jul 17 10:02:12.145266 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.144419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:12.242534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.242455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:12.320084 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.319890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:12.393020 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.392838 2562 patch_prober.go:28] interesting pod/image-registry-5f946b67c6-wjnvb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 10:02:12.393020 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.392930 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 10:02:12.742763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.742726 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:12.742969 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.742793 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:12.745794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.745770 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:12.769189 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.769137 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6d48df75f4-wzh9s" podStartSLOduration=4.51554293 podStartE2EDuration="14.769122402s" totalImagesPullingTime="10.253579472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:12.058032144 +0000 UTC m=+89.202608715" watchObservedRunningTime="2026-07-17 10:02:12.769122402 +0000 UTC m=+89.913698971" Jul 17 10:02:12.972201 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:12.972146 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-696d6cd74-glp2h" Jul 17 10:02:13.831449 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:13.831420 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:02:14.006212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:14.006177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:14.107753 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:14.107631 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.063142 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.063104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.186236 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.186198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.446261 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.446182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.527912 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.527874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.835459 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.835405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:15.955243 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:15.952657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:16.651023 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:16.650975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:16.763950 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:16.763886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:19.152925 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:19.152872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:19.254448 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:19.254394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:22.407376 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:22.407349 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:02:22.670456 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:22.670381 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:22.773481 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:22.773447 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:22.823670 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:22.823646 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6cm7" Jul 17 10:02:22.889151 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:22.889114 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:23.521394 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:23.521354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:23.654967 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:23.654460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:23.724892 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:23.724858 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:24.024572 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.024531 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kfj2r" event={"ID":"b9615493-04d1-48bb-adbe-926093f5d24b","Type":"ContainerStarted","Data":"09536b03286b0b6358ab903f1b08e4b4da6ed8deeb08605c6c75c99e358f6326"} Jul 17 10:02:24.026384 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.026354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" event={"ID":"2c6b65b3-a081-49bc-8f6b-ba46bff55fba","Type":"ContainerStarted","Data":"a64a0375ad92c1d65026acdbeb3a66cf09de72af85f6b5fb7c627575dce8925c"} Jul 17 10:02:24.028531 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.028504 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-zwbvr" event={"ID":"cb81f3aa-c45c-4a69-bac8-8f768de18821","Type":"ContainerStarted","Data":"561777f27ce2aa50f593d2f485751409080a2b04a1d6f50e3429914f3537bc14"} Jul 17 10:02:24.028788 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.028767 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:02:24.035793 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.035764 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-zwbvr" Jul 17 10:02:24.046165 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.046119 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kfj2r" podStartSLOduration=17.681743422 podStartE2EDuration="47.046100796s" totalImagesPullingTime="29.364357374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:01:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:24.045313066 +0000 UTC m=+101.189889638" watchObservedRunningTime="2026-07-17 10:02:24.046100796 +0000 UTC m=+101.190677367" Jul 17 10:02:24.063319 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.063264 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-sf2v5" podStartSLOduration=42.054178365 podStartE2EDuration="54.063245152s" totalImagesPullingTime="12.009066787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:24.061305788 +0000 UTC m=+101.205882360" watchObservedRunningTime="2026-07-17 10:02:24.063245152 +0000 UTC m=+101.207821724" Jul 17 10:02:24.514526 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.514490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:24.622537 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.622496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:24.792710 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:24.792635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:25.504326 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:25.504289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:25.605707 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:25.605668 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:25.706879 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:25.706844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:28.002629 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:28.002567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:29.844439 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:29.844402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:29.942527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:29.942487 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:30.748371 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:30.748336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:30.831045 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:30.831001 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:30.938681 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:30.938639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:31.112001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:31.111919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:31.694015 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:31.693883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:31.796933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:31.796847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:31.870262 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:31.870233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:32.980794 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:32.980757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:34.504592 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:34.504551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:34.573801 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:34.573765 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:34.938409 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:34.938323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.195875 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.195776 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.233372 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.233318 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-zwbvr" podStartSLOduration=15.230673948 podStartE2EDuration="37.233301004s" totalImagesPullingTime="22.002627056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:01:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:24.083374006 +0000 UTC m=+101.227950577" watchObservedRunningTime="2026-07-17 10:02:35.233301004 +0000 UTC m=+112.377877611" Jul 17 10:02:35.233638 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.233621 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2s586"] Jul 17 10:02:35.253818 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.253788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.256926 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.256673 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 10:02:35.256926 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.256724 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rbfg8\"" Jul 17 10:02:35.257114 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.256942 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 10:02:35.257687 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.257654 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 10:02:35.257802 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.257723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 10:02:35.294808 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.294775 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-textfile\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.294808 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.294811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-metrics-client-ca\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295051 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.294830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-root\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295051 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.294960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295051 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.294996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-accelerators-collector-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295051 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.295031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-wtmp\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.295084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.295146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmn6z\" (UniqueName: \"kubernetes.io/projected/524dccbc-d633-4df5-8c0e-92b367d4f854-kube-api-access-hmn6z\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.295289 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.295223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-sys\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.344562 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.344524 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.396721 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-sys\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-textfile\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-metrics-client-ca\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-root\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396819 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-sys\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.396933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-accelerators-collector-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-wtmp\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396984 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-root\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.396996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.397055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmn6z\" (UniqueName: \"kubernetes.io/projected/524dccbc-d633-4df5-8c0e-92b367d4f854-kube-api-access-hmn6z\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:02:35.397078 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.397128 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-textfile\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397260 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:02:35.397139 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls podName:524dccbc-d633-4df5-8c0e-92b367d4f854 nodeName:}" failed. No retries permitted until 2026-07-17 10:02:35.897118626 +0000 UTC m=+113.041695190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls") pod "node-exporter-2s586" (UID: "524dccbc-d633-4df5-8c0e-92b367d4f854") : secret "node-exporter-tls" not found Jul 17 10:02:35.397592 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.397275 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-wtmp\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397876 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.397854 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-metrics-client-ca\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.397982 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.397875 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-accelerators-collector-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.399945 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.399924 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.408112 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.408087 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmn6z\" (UniqueName: \"kubernetes.io/projected/524dccbc-d633-4df5-8c0e-92b367d4f854-kube-api-access-hmn6z\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.467456 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.467363 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.564640 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.564592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.733857 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.733778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.834338 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.834303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:35.901279 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.901241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:35.903527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:35.903503 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/524dccbc-d633-4df5-8c0e-92b367d4f854-node-exporter-tls\") pod \"node-exporter-2s586\" (UID: \"524dccbc-d633-4df5-8c0e-92b367d4f854\") " pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:36.166299 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:36.166267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2s586" Jul 17 10:02:36.195917 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:36.195871 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:36.203377 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:02:36.203351 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524dccbc_d633_4df5_8c0e_92b367d4f854.slice/crio-cd52799ae6cad381b96fdece31ca7981e6b588a85803cd1b9e7ddc44ad0bb035 WatchSource:0}: Error finding container cd52799ae6cad381b96fdece31ca7981e6b588a85803cd1b9e7ddc44ad0bb035: Status 404 returned error can't find the container with id cd52799ae6cad381b96fdece31ca7981e6b588a85803cd1b9e7ddc44ad0bb035 Jul 17 10:02:36.284176 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:36.284132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:36.540557 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:36.540518 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:37.097835 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:37.097799 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2s586" event={"ID":"524dccbc-d633-4df5-8c0e-92b367d4f854","Type":"ContainerStarted","Data":"cd52799ae6cad381b96fdece31ca7981e6b588a85803cd1b9e7ddc44ad0bb035"} Jul 17 10:02:38.103363 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.103329 2562 generic.go:356] "Generic (PLEG): container finished" podID="524dccbc-d633-4df5-8c0e-92b367d4f854" containerID="21464b59c0d54ff4f9c96dde2967f65f6410302b14563188b73b7be4effb71fd" exitCode=0 Jul 17 10:02:38.103741 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.103404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2s586" event={"ID":"524dccbc-d633-4df5-8c0e-92b367d4f854","Type":"ContainerDied","Data":"21464b59c0d54ff4f9c96dde2967f65f6410302b14563188b73b7be4effb71fd"} Jul 17 10:02:38.200259 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.200229 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:38.301923 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.301447 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:38.412769 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.412679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:38.563239 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:38.563207 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:39.109648 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.109616 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2s586" event={"ID":"524dccbc-d633-4df5-8c0e-92b367d4f854","Type":"ContainerStarted","Data":"411e5287c81208fb4cc35dcb9dff64cbb708ad7ac593f6c61c0fe2e20fe9a0b0"} Jul 17 10:02:39.110092 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.109677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2s586" event={"ID":"524dccbc-d633-4df5-8c0e-92b367d4f854","Type":"ContainerStarted","Data":"d3b0448760afa47bdb8985f005a21001f9a8bed653de6e2645b35c8604b8e57a"} Jul 17 10:02:39.150621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.150571 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2s586" podStartSLOduration=2.761899955 podStartE2EDuration="4.150552921s" totalImagesPullingTime="1.290635111s" totalInitContainerRuntime="98.017855ms" isStatefulPod=true podCreationTimestamp="2026-07-17 10:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:02:39.149236296 +0000 UTC m=+116.293812867" watchObservedRunningTime="2026-07-17 10:02:39.150552921 +0000 UTC m=+116.295129491" Jul 17 10:02:39.527793 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.527755 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:39.696644 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.696604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:39.826458 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:39.826358 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:40.068687 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:40.068648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:42.282182 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:42.282136 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:42.385911 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:42.385859 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:45.820240 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:45.820194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:45.911227 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:45.911195 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:47.142820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.142783 2562 generic.go:356] "Generic (PLEG): container finished" podID="3bf9d252-de24-473c-9e61-ec845ad6e249" containerID="7ac7151010617b15be8b2f6cb8bfe6ba35d6cd5e771ada50dfeb4f0a4a14aec5" exitCode=0 Jul 17 10:02:47.143228 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.142855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" event={"ID":"3bf9d252-de24-473c-9e61-ec845ad6e249","Type":"ContainerDied","Data":"7ac7151010617b15be8b2f6cb8bfe6ba35d6cd5e771ada50dfeb4f0a4a14aec5"} Jul 17 10:02:47.143272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.143245 2562 scope.go:117] "RemoveContainer" containerID="7ac7151010617b15be8b2f6cb8bfe6ba35d6cd5e771ada50dfeb4f0a4a14aec5" Jul 17 10:02:47.431145 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.431061 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerName="registry" containerID="cri-o://78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5" gracePeriod=30 Jul 17 10:02:47.709406 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.709346 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:02:47.797558 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797527 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czzxl\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797706 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797597 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797706 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797626 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797706 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797760 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797785 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.797858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.797819 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates\") pod \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\" (UID: \"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee\") " Jul 17 10:02:47.798359 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.798322 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 10:02:47.798664 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.798598 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 10:02:47.800723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.800412 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:02:47.800723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.800647 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl" (OuterVolumeSpecName: "kube-api-access-czzxl") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "kube-api-access-czzxl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:02:47.800723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.800652 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:02:47.801155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.801034 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:02:47.802817 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.802790 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:02:47.813830 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.813800 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" (UID: "ae9b93bb-6006-44dd-afcf-2f3caa96a0ee"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 10:02:47.899395 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899365 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-trusted-ca\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899395 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899390 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-ca-trust-extracted\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899404 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-installation-pull-secrets\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899416 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-certificates\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899428 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czzxl\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-kube-api-access-czzxl\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899440 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-registry-tls\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899452 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-bound-sa-token\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:47.899591 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:47.899466 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee-image-registry-private-configuration\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:02:48.148291 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.148256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-br886" event={"ID":"3bf9d252-de24-473c-9e61-ec845ad6e249","Type":"ContainerStarted","Data":"144f31b47bcda05afdd9a01a42db340cbf3f1df923f6418a1f673d17632a5468"} Jul 17 10:02:48.149453 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.149426 2562 generic.go:356] "Generic (PLEG): container finished" podID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerID="78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5" exitCode=0 Jul 17 10:02:48.149539 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.149458 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" Jul 17 10:02:48.149539 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.149510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" event={"ID":"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee","Type":"ContainerDied","Data":"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5"} Jul 17 10:02:48.149605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.149550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5f946b67c6-wjnvb" event={"ID":"ae9b93bb-6006-44dd-afcf-2f3caa96a0ee","Type":"ContainerDied","Data":"5e6435fba2453997186ea037cd8801ad99b6cb73dd842326b8957becae34bbb9"} Jul 17 10:02:48.149605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.149571 2562 scope.go:117] "RemoveContainer" containerID="78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5" Jul 17 10:02:48.158052 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.158021 2562 scope.go:117] "RemoveContainer" containerID="78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5" Jul 17 10:02:48.158293 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:02:48.158271 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5\": container with ID starting with 78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5 not found: ID does not exist" containerID="78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5" Jul 17 10:02:48.158358 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.158305 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5"} err="failed to get container status \"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5\": rpc error: code = NotFound desc = could not find container \"78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5\": container with ID starting with 78d8e48bccec5c8e79455532b4a24264cb67268c1f72a5e7b4bb07b6e98774b5 not found: ID does not exist" Jul 17 10:02:48.188079 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.188056 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:02:48.194082 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.194056 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5f946b67c6-wjnvb"] Jul 17 10:02:48.544912 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:48.544870 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" path="/var/lib/kubelet/pods/ae9b93bb-6006-44dd-afcf-2f3caa96a0ee/volumes" Jul 17 10:02:49.154784 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:49.154752 2562 generic.go:356] "Generic (PLEG): container finished" podID="83df9797-1769-4cb1-9872-8e72f02f039a" containerID="2b4a6855245846b3a1d590ac33ce56e6285ae7688f37929508c21e4f73b6e91e" exitCode=0 Jul 17 10:02:49.155318 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:49.154823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" event={"ID":"83df9797-1769-4cb1-9872-8e72f02f039a","Type":"ContainerDied","Data":"2b4a6855245846b3a1d590ac33ce56e6285ae7688f37929508c21e4f73b6e91e"} Jul 17 10:02:49.155318 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:49.155208 2562 scope.go:117] "RemoveContainer" containerID="2b4a6855245846b3a1d590ac33ce56e6285ae7688f37929508c21e4f73b6e91e" Jul 17 10:02:50.161327 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:50.161294 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-4n4s6" event={"ID":"83df9797-1769-4cb1-9872-8e72f02f039a","Type":"ContainerStarted","Data":"ca0acb64f999576904d30298c4b50064cd272a722f1eda85ac3db08b5324c44e"} Jul 17 10:02:50.856269 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:50.856230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:50.948390 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:50.948355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:51.033682 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:51.033648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:02:57.191118 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:57.191071 2562 generic.go:356] "Generic (PLEG): container finished" podID="fb706e28-7cc9-4982-88d4-833d3f0f1957" containerID="79c73914ee743c88c6ee3e79b23e53c2f3db43942b52b44f37c03e7bc196c374" exitCode=0 Jul 17 10:02:57.191515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:57.191144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-ckg48" event={"ID":"fb706e28-7cc9-4982-88d4-833d3f0f1957","Type":"ContainerDied","Data":"79c73914ee743c88c6ee3e79b23e53c2f3db43942b52b44f37c03e7bc196c374"} Jul 17 10:02:57.191515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:57.191494 2562 scope.go:117] "RemoveContainer" containerID="79c73914ee743c88c6ee3e79b23e53c2f3db43942b52b44f37c03e7bc196c374" Jul 17 10:02:58.197340 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:02:58.197306 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-ckg48" event={"ID":"fb706e28-7cc9-4982-88d4-833d3f0f1957","Type":"ContainerStarted","Data":"21db619237e2e4be68ecccc2c82ece1100a136eae612d260af72833fe6928c22"} Jul 17 10:03:00.808272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:03:00.808226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:03:00.914455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:03:00.914423 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:03:54.590951 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:03:54.590882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:03:54.859048 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:03:54.858957 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:04.654419 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:04.654379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:04.729895 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:04.729861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:09.869647 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:09.869607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:09.972343 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:09.972307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:10.211453 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:10.211335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:10.288867 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:10.288834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:10.785406 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:10.785373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:10.871662 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:10.871620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:21.079730 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:21.079696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:21.180371 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:21.180338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:21.843890 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:21.843848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:21.906594 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:21.906560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:27.982210 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:27.982177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:28.082734 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:28.082699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:30.815177 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:30.815108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:30.917304 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:30.917267 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:04:56.097653 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:04:56.097621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:00.194261 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:00.194230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:00.313295 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:00.313252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:15.861645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:15.861557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:24.159372 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:24.159335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:27.092733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:27.092700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:28.100384 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:28.100349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:30.698974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:30.698936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:30.763821 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:30.763788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:32.462128 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:32.462087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:32.569486 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:32.569451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:32.688656 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:32.688624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:35.026870 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:35.026835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:35.125827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:35.125792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:37.530172 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:37.530121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:37.681937 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:37.681881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:42.474128 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:42.474086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:43.470464 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:43.470431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:43.687820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:43.687785 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:44.360287 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:44.360258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:05:44.362211 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:44.362186 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:05:44.374568 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:44.374545 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 10:05:52.570961 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:52.570920 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:53.720577 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:53.720534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:55.644056 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:55.644015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:05:55.742072 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:05:55.742040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:01.184118 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:01.184078 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:01.308398 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:01.308357 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:02.875371 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:02.875338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:09.407959 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:09.407922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:09.586243 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:09.586208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:15.257937 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:15.257875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:15.365534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:15.365482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:15.662396 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:15.662297 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:15.968754 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:15.968667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.090486 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.090442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.215841 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.215814 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg"] Jul 17 10:06:16.216136 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.216123 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerName="registry" Jul 17 10:06:16.216181 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.216138 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerName="registry" Jul 17 10:06:16.216219 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.216209 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae9b93bb-6006-44dd-afcf-2f3caa96a0ee" containerName="registry" Jul 17 10:06:16.219169 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.219123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.224616 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.224595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 10:06:16.224745 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.224616 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 10:06:16.230012 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.229996 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m7j2l\"" Jul 17 10:06:16.230103 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.230027 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 10:06:16.230103 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.230076 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 10:06:16.267271 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.267249 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg"] Jul 17 10:06:16.326034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.325092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-manifests\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.326034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.325142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-tmp\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.326034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.325185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz68z\" (UniqueName: \"kubernetes.io/projected/7afba983-36a1-4711-9007-893c20c0e810-kube-api-access-zz68z\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.326034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.325224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.326034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.325277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-webhook-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.425734 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.425707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-webhook-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.425851 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.425747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-manifests\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.425851 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.425769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-tmp\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.425851 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.425787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz68z\" (UniqueName: \"kubernetes.io/projected/7afba983-36a1-4711-9007-893c20c0e810-kube-api-access-zz68z\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.426041 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.425929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.426194 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.426172 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-manifests\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.428032 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.428013 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7afba983-36a1-4711-9007-893c20c0e810-tmp\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.428267 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.428243 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.428332 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.428323 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7afba983-36a1-4711-9007-893c20c0e810-webhook-cert\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.445707 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.445683 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz68z\" (UniqueName: \"kubernetes.io/projected/7afba983-36a1-4711-9007-893c20c0e810-kube-api-access-zz68z\") pod \"opendatahub-operator-controller-manager-79948f9745-xxhsg\" (UID: \"7afba983-36a1-4711-9007-893c20c0e810\") " pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.473527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.473474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.529014 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.528988 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:16.568065 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.568031 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.665828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.665798 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg"] Jul 17 10:06:16.670356 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:16.670324 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7afba983_36a1_4711_9007_893c20c0e810.slice/crio-5f1d568118777e1f73406e0707a569edd4672cad37238280cd8614df9566e2b4 WatchSource:0}: Error finding container 5f1d568118777e1f73406e0707a569edd4672cad37238280cd8614df9566e2b4: Status 404 returned error can't find the container with id 5f1d568118777e1f73406e0707a569edd4672cad37238280cd8614df9566e2b4 Jul 17 10:06:16.671356 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.671335 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 10:06:16.671498 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.671462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.774500 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.774472 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.897132 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.897107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:16.953050 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.953023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" event={"ID":"7afba983-36a1-4711-9007-893c20c0e810","Type":"ContainerStarted","Data":"5f1d568118777e1f73406e0707a569edd4672cad37238280cd8614df9566e2b4"} Jul 17 10:06:16.998280 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:16.998257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:19.973003 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:19.972921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" event={"ID":"7afba983-36a1-4711-9007-893c20c0e810","Type":"ContainerStarted","Data":"67f62cbb9b4ea22fb9f6e8aa5d13fa8a1da57e7a21ee623347526a5928c3546d"} Jul 17 10:06:20.979521 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:20.979423 2562 generic.go:356] "Generic (PLEG): container finished" podID="7afba983-36a1-4711-9007-893c20c0e810" containerID="67f62cbb9b4ea22fb9f6e8aa5d13fa8a1da57e7a21ee623347526a5928c3546d" exitCode=0 Jul 17 10:06:20.979521 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:20.979488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" event={"ID":"7afba983-36a1-4711-9007-893c20c0e810","Type":"ContainerDied","Data":"67f62cbb9b4ea22fb9f6e8aa5d13fa8a1da57e7a21ee623347526a5928c3546d"} Jul 17 10:06:21.985677 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:21.985587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" event={"ID":"7afba983-36a1-4711-9007-893c20c0e810","Type":"ContainerStarted","Data":"dd358d2dd4bd3ad981cad2a3f150605fdf316ea5cfe838cd50b1e08efa28f27e"} Jul 17 10:06:21.986040 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:21.985692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:22.015963 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:22.015888 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" podStartSLOduration=1.4362002870000001 podStartE2EDuration="6.015872057s" totalImagesPullingTime="3.528010133s" totalInitContainerRuntime="1.051661637s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:22.014273466 +0000 UTC m=+339.158850036" watchObservedRunningTime="2026-07-17 10:06:22.015872057 +0000 UTC m=+339.160448626" Jul 17 10:06:23.883872 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:23.883838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:32.991709 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:32.991679 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79948f9745-xxhsg" Jul 17 10:06:35.301593 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:35.301551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:35.434149 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:35.434069 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.080073 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.080033 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.374623 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.374535 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n94z8"] Jul 17 10:06:36.378355 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.378337 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.390561 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.390499 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.390561 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.390547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhcpj\" (UniqueName: \"kubernetes.io/projected/0404b0e1-4dff-4a12-aa28-86adddd6a946-kube-api-access-bhcpj\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.395613 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.395594 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mffgn\"" Jul 17 10:06:36.402711 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.402694 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 17 10:06:36.424237 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.424210 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n94z8"] Jul 17 10:06:36.491280 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.491245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.491441 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.491298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhcpj\" (UniqueName: \"kubernetes.io/projected/0404b0e1-4dff-4a12-aa28-86adddd6a946-kube-api-access-bhcpj\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.491441 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:06:36.491412 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 17 10:06:36.491519 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:06:36.491491 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert podName:0404b0e1-4dff-4a12-aa28-86adddd6a946 nodeName:}" failed. No retries permitted until 2026-07-17 10:06:36.991470963 +0000 UTC m=+354.136047520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert") pod "odh-model-controller-7998c67dc4-n94z8" (UID: "0404b0e1-4dff-4a12-aa28-86adddd6a946") : secret "odh-model-controller-webhook-cert" not found Jul 17 10:06:36.496022 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.495989 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj"] Jul 17 10:06:36.499114 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.499094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.517454 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.517432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6ds4w\"" Jul 17 10:06:36.518137 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.518124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 10:06:36.521875 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.521856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 10:06:36.533483 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.533453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.534418 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.534397 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj"] Jul 17 10:06:36.537809 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.537782 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhcpj\" (UniqueName: \"kubernetes.io/projected/0404b0e1-4dff-4a12-aa28-86adddd6a946-kube-api-access-bhcpj\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.592143 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.592112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tls-certs\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.592292 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.592175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tmp\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.592292 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.592207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-kube-api-access-dtb68\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.656830 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.656742 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.693485 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.693449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-kube-api-access-dtb68\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.693684 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.693529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tls-certs\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.693684 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.693565 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tmp\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.696043 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.696020 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tls-certs\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.696281 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.696262 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-tmp\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.707865 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.707832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtb68\" (UniqueName: \"kubernetes.io/projected/02901b9b-68d5-4e6f-bb0d-a6b9ed950c03-kube-api-access-dtb68\") pod \"kube-auth-proxy-67bb8bccf4-772fj\" (UID: \"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03\") " pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.754469 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.754417 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.808307 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.808275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" Jul 17 10:06:36.865536 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.865425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.959673 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.959644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj"] Jul 17 10:06:36.960938 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:36.960883 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02901b9b_68d5_4e6f_bb0d_a6b9ed950c03.slice/crio-bad1a58c0462f97c8abc52fea9573dd72a4afeb3e3190bbc4f218eabc0b02d47 WatchSource:0}: Error finding container bad1a58c0462f97c8abc52fea9573dd72a4afeb3e3190bbc4f218eabc0b02d47: Status 404 returned error can't find the container with id bad1a58c0462f97c8abc52fea9573dd72a4afeb3e3190bbc4f218eabc0b02d47 Jul 17 10:06:36.961436 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.961407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:36.996435 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.996409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:36.998734 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:36.998712 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0404b0e1-4dff-4a12-aa28-86adddd6a946-cert\") pod \"odh-model-controller-7998c67dc4-n94z8\" (UID: \"0404b0e1-4dff-4a12-aa28-86adddd6a946\") " pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:37.050016 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.049978 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" event={"ID":"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03","Type":"ContainerStarted","Data":"bad1a58c0462f97c8abc52fea9573dd72a4afeb3e3190bbc4f218eabc0b02d47"} Jul 17 10:06:37.288574 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.288539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:37.444494 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.443433 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:37.445658 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.445628 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-n94z8"] Jul 17 10:06:37.450077 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:37.450048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0404b0e1_4dff_4a12_aa28_86adddd6a946.slice/crio-dbaab1d23291fb8cd23e3d107646dfaccf1d5672d29d01f8b4d3f52d045a21c5 WatchSource:0}: Error finding container dbaab1d23291fb8cd23e3d107646dfaccf1d5672d29d01f8b4d3f52d045a21c5: Status 404 returned error can't find the container with id dbaab1d23291fb8cd23e3d107646dfaccf1d5672d29d01f8b4d3f52d045a21c5 Jul 17 10:06:37.497666 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.497625 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7fwqm"] Jul 17 10:06:37.502049 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.502027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.502530 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.502501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlnk\" (UniqueName: \"kubernetes.io/projected/b1084cf9-fade-403c-88e6-2d9d9e47ad22-kube-api-access-lqlnk\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.502628 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.502571 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.504850 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.504822 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 17 10:06:37.521600 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.521574 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7fwqm"] Jul 17 10:06:37.603534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.603437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlnk\" (UniqueName: \"kubernetes.io/projected/b1084cf9-fade-403c-88e6-2d9d9e47ad22-kube-api-access-lqlnk\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.603534 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.603496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.603713 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:06:37.603627 2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 17 10:06:37.603713 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:06:37.603694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs podName:b1084cf9-fade-403c-88e6-2d9d9e47ad22 nodeName:}" failed. No retries permitted until 2026-07-17 10:06:38.103672263 +0000 UTC m=+355.248248814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs") pod "model-serving-api-54d89bd5fc-7fwqm" (UID: "b1084cf9-fade-403c-88e6-2d9d9e47ad22") : secret "model-serving-api-tls" not found Jul 17 10:06:37.626255 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.626212 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlnk\" (UniqueName: \"kubernetes.io/projected/b1084cf9-fade-403c-88e6-2d9d9e47ad22-kube-api-access-lqlnk\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:37.854119 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:37.854026 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:38.062631 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.062576 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" event={"ID":"0404b0e1-4dff-4a12-aa28-86adddd6a946","Type":"ContainerStarted","Data":"dbaab1d23291fb8cd23e3d107646dfaccf1d5672d29d01f8b4d3f52d045a21c5"} Jul 17 10:06:38.107242 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.107148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:38.110507 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.110472 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1084cf9-fade-403c-88e6-2d9d9e47ad22-tls-certs\") pod \"model-serving-api-54d89bd5fc-7fwqm\" (UID: \"b1084cf9-fade-403c-88e6-2d9d9e47ad22\") " pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:38.113064 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.113042 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:38.351131 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.351026 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7fwqm"] Jul 17 10:06:38.355187 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:38.355084 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1084cf9_fade_403c_88e6_2d9d9e47ad22.slice/crio-b85012351a3ef3022502261aac05a866d548651d9f55349a50674aee51341cf9 WatchSource:0}: Error finding container b85012351a3ef3022502261aac05a866d548651d9f55349a50674aee51341cf9: Status 404 returned error can't find the container with id b85012351a3ef3022502261aac05a866d548651d9f55349a50674aee51341cf9 Jul 17 10:06:38.547121 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.547075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:38.556463 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.556335 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:38.560522 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.560497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.569619 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.569183 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 10:06:38.573252 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.570740 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 10:06:38.573252 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.571335 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 10:06:38.576656 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.575838 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 10:06:38.576656 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.576036 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-szrjx\"" Jul 17 10:06:38.586294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.586267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.611766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.611880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.611926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.611958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdtjm\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.612009 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.612036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.613308 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.612061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.654381 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.654344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:38.712604 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.712556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.712784 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.712610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.712784 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.712647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdtjm\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.713089 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.712991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.713089 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.713035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.713089 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.713069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.713362 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.713147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.714043 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.713815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.715545 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.715523 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.717275 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.717210 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.717958 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.717918 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.718433 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.718409 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.735160 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.735106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdtjm\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.736213 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.736165 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token\") pod \"istiod-openshift-gateway-7574459656-5cczm\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:38.878252 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:38.878157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:39.070559 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:39.070509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" event={"ID":"b1084cf9-fade-403c-88e6-2d9d9e47ad22","Type":"ContainerStarted","Data":"b85012351a3ef3022502261aac05a866d548651d9f55349a50674aee51341cf9"} Jul 17 10:06:39.090953 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:39.090920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:39.096416 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:39.096383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf2e558a_775f_44e6_90e8_05cfc6ef5f31.slice/crio-0504a11bc1e4703f26d214ed9c69d5b1da5d0682e3537e085786cd85a7303ad5 WatchSource:0}: Error finding container 0504a11bc1e4703f26d214ed9c69d5b1da5d0682e3537e085786cd85a7303ad5: Status 404 returned error can't find the container with id 0504a11bc1e4703f26d214ed9c69d5b1da5d0682e3537e085786cd85a7303ad5 Jul 17 10:06:40.082150 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:40.082114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" event={"ID":"af2e558a-775f-44e6-90e8-05cfc6ef5f31","Type":"ContainerStarted","Data":"0504a11bc1e4703f26d214ed9c69d5b1da5d0682e3537e085786cd85a7303ad5"} Jul 17 10:06:40.173632 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:40.173578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:42.104499 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.104409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" event={"ID":"0404b0e1-4dff-4a12-aa28-86adddd6a946","Type":"ContainerStarted","Data":"0c21db1a916fa3d2704ff49a52dc3c0696231c9411535c95ca16a6887aa3373e"} Jul 17 10:06:42.105009 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.104758 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:42.106317 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.106288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" event={"ID":"b1084cf9-fade-403c-88e6-2d9d9e47ad22","Type":"ContainerStarted","Data":"658aa3e93a8f7d05f0a6c7b7b54e7fab87e2ae5dd568f550d8fc970222604bc2"} Jul 17 10:06:42.106444 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.106361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:42.108073 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.108047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" event={"ID":"02901b9b-68d5-4e6f-bb0d-a6b9ed950c03","Type":"ContainerStarted","Data":"182db4c9770a6645bd48db7aae6e4b1066016165d5272a7aeb91cf692fc838f9"} Jul 17 10:06:42.144464 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.144396 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" podStartSLOduration=1.820645346 podStartE2EDuration="6.144380102s" totalImagesPullingTime="4.323734756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:42.142058837 +0000 UTC m=+359.286635408" watchObservedRunningTime="2026-07-17 10:06:42.144380102 +0000 UTC m=+359.288956672" Jul 17 10:06:42.231788 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.231116 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" podStartSLOduration=1.808779293 podStartE2EDuration="5.231091323s" totalImagesPullingTime="3.42231203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:42.230269245 +0000 UTC m=+359.374845816" watchObservedRunningTime="2026-07-17 10:06:42.231091323 +0000 UTC m=+359.375667894" Jul 17 10:06:42.231788 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:42.231490 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67bb8bccf4-772fj" podStartSLOduration=1.413267738 podStartE2EDuration="6.231479467s" totalImagesPullingTime="4.818211729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:42.193476657 +0000 UTC m=+359.338053227" watchObservedRunningTime="2026-07-17 10:06:42.231479467 +0000 UTC m=+359.376056040" Jul 17 10:06:43.124122 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:43.124079 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 17 10:06:43.124421 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:43.124161 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 17 10:06:44.122750 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.122715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" event={"ID":"af2e558a-775f-44e6-90e8-05cfc6ef5f31","Type":"ContainerStarted","Data":"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0"} Jul 17 10:06:44.122962 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.122947 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:44.124442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.124418 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5cczm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 10:06:44.124797 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.124462 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 10:06:44.190022 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.189968 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" podStartSLOduration=2.166689608 podStartE2EDuration="6.189953186s" totalImagesPullingTime="4.023263578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:44.189041186 +0000 UTC m=+361.333617757" watchObservedRunningTime="2026-07-17 10:06:44.189953186 +0000 UTC m=+361.334529755" Jul 17 10:06:44.884584 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:44.884534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:45.041109 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:45.041075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:45.127242 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:45.127209 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-5cczm container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 10:06:45.127581 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:45.127274 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 10:06:45.682077 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:45.682026 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:45.993807 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:45.993733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:46.135488 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:46.135456 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:48.127669 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:48.127642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:50.945676 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:50.945641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:51.067298 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.067261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:51.181747 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.181709 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-phz9m"] Jul 17 10:06:51.190041 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.190012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.197455 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.197428 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fxt9v\"" Jul 17 10:06:51.197924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.197876 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 17 10:06:51.206574 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.206547 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-phz9m"] Jul 17 10:06:51.229513 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.229475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5ss\" (UniqueName: \"kubernetes.io/projected/450a9242-3ded-4464-9fc2-bad31a10d694-kube-api-access-5p5ss\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.229707 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.229579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450a9242-3ded-4464-9fc2-bad31a10d694-cert\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.305008 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.304953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:51.330864 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.330829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450a9242-3ded-4464-9fc2-bad31a10d694-cert\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.331084 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.330936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5ss\" (UniqueName: \"kubernetes.io/projected/450a9242-3ded-4464-9fc2-bad31a10d694-kube-api-access-5p5ss\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.333460 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.333437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/450a9242-3ded-4464-9fc2-bad31a10d694-cert\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.413497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.413460 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5ss\" (UniqueName: \"kubernetes.io/projected/450a9242-3ded-4464-9fc2-bad31a10d694-kube-api-access-5p5ss\") pod \"kserve-controller-manager-d6f4b65b8-phz9m\" (UID: \"450a9242-3ded-4464-9fc2-bad31a10d694\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.500963 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.500931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:51.515603 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.515563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:51.960001 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.959920 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:51.960361 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:51.960109 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" containerID="cri-o://68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0" gracePeriod=30 Jul 17 10:06:52.007008 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:06:52.006981 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450a9242_3ded_4464_9fc2_bad31a10d694.slice/crio-eebd4502de58e01ecc38d3b6b7da85848a861c0d3d82b5413061c17b5a3f2104 WatchSource:0}: Error finding container eebd4502de58e01ecc38d3b6b7da85848a861c0d3d82b5413061c17b5a3f2104: Status 404 returned error can't find the container with id eebd4502de58e01ecc38d3b6b7da85848a861c0d3d82b5413061c17b5a3f2104 Jul 17 10:06:52.032319 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.032285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-phz9m"] Jul 17 10:06:52.158790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.158749 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" event={"ID":"450a9242-3ded-4464-9fc2-bad31a10d694","Type":"ContainerStarted","Data":"eebd4502de58e01ecc38d3b6b7da85848a861c0d3d82b5413061c17b5a3f2104"} Jul 17 10:06:52.168681 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.168645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:52.297377 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.297351 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:52.338523 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338436 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdtjm\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.338523 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338488 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.338523 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338509 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.338766 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.338823 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338807 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.338882 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338859 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.339027 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.338893 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts\") pod \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\" (UID: \"af2e558a-775f-44e6-90e8-05cfc6ef5f31\") " Jul 17 10:06:52.339801 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.339758 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 10:06:52.341458 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341433 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs" (OuterVolumeSpecName: "local-certs") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 10:06:52.341630 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341604 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm" (OuterVolumeSpecName: "kube-api-access-pdtjm") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "kube-api-access-pdtjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:06:52.341809 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341786 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:06:52.341915 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341793 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token" (OuterVolumeSpecName: "istio-token") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:06:52.341915 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341854 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:06:52.341989 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.341939 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts" (OuterVolumeSpecName: "cacerts") pod "af2e558a-775f-44e6-90e8-05cfc6ef5f31" (UID: "af2e558a-775f-44e6-90e8-05cfc6ef5f31"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:06:52.440305 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440257 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-dns-cert\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440305 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440302 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-token\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440318 2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-csr-ca-configmap\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440333 2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-cacerts\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440342 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdtjm\" (UniqueName: \"kubernetes.io/projected/af2e558a-775f-44e6-90e8-05cfc6ef5f31-kube-api-access-pdtjm\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440351 2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af2e558a-775f-44e6-90e8-05cfc6ef5f31-local-certs\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.440497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.440359 2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af2e558a-775f-44e6-90e8-05cfc6ef5f31-istio-kubeconfig\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:06:52.902988 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:52.902824 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:53.031081 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.031038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:53.119464 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.119442 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7fwqm" Jul 17 10:06:53.165950 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.165833 2562 generic.go:356] "Generic (PLEG): container finished" podID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerID="68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0" exitCode=0 Jul 17 10:06:53.165950 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.165871 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" event={"ID":"af2e558a-775f-44e6-90e8-05cfc6ef5f31","Type":"ContainerDied","Data":"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0"} Jul 17 10:06:53.165950 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.165934 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" Jul 17 10:06:53.166220 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.165960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-5cczm" event={"ID":"af2e558a-775f-44e6-90e8-05cfc6ef5f31","Type":"ContainerDied","Data":"0504a11bc1e4703f26d214ed9c69d5b1da5d0682e3537e085786cd85a7303ad5"} Jul 17 10:06:53.166220 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.165991 2562 scope.go:117] "RemoveContainer" containerID="68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0" Jul 17 10:06:53.171252 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.171205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:06:53.177331 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.177307 2562 scope.go:117] "RemoveContainer" containerID="68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0" Jul 17 10:06:53.177634 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:06:53.177589 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0\": container with ID starting with 68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0 not found: ID does not exist" containerID="68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0" Jul 17 10:06:53.177722 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.177645 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0"} err="failed to get container status \"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0\": rpc error: code = NotFound desc = could not find container \"68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0\": container with ID starting with 68a679c1858d103fb3550670865368c16f54cebbf6d6196368e60a53cda424d0 not found: ID does not exist" Jul 17 10:06:53.211032 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.211004 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:53.219604 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:53.219566 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-5cczm"] Jul 17 10:06:54.125396 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:54.125361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-n94z8" Jul 17 10:06:54.547977 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:54.547944 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" path="/var/lib/kubelet/pods/af2e558a-775f-44e6-90e8-05cfc6ef5f31/volumes" Jul 17 10:06:55.177830 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:55.177802 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" event={"ID":"450a9242-3ded-4464-9fc2-bad31a10d694","Type":"ContainerStarted","Data":"2dced81bcf27b6bf03851eacc5099c2d0286e8d9b1b052235a9ec28c32162592"} Jul 17 10:06:55.178153 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:55.177922 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:06:55.203013 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:06:55.202970 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" podStartSLOduration=1.098631111 podStartE2EDuration="4.202954576s" totalImagesPullingTime="3.104323465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:06:55.20018111 +0000 UTC m=+372.344757680" watchObservedRunningTime="2026-07-17 10:06:55.202954576 +0000 UTC m=+372.347531145" Jul 17 10:07:02.224621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:02.224583 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:07:26.187664 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:26.187629 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-phz9m" Jul 17 10:07:36.686624 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.686580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:07:36.790217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.790178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:07:36.815526 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.815487 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:36.815839 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.815827 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" Jul 17 10:07:36.815887 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.815841 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" Jul 17 10:07:36.815959 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.815931 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2e558a-775f-44e6-90e8-05cfc6ef5f31" containerName="discovery" Jul 17 10:07:36.818705 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.818677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:36.822121 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.822098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 10:07:36.822238 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.822112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 10:07:36.823064 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.823047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ztbsj\"" Jul 17 10:07:36.834270 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.834236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:36.865627 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.865590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:07:36.916764 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:36.916724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vr8n\" (UniqueName: \"kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n\") pod \"kuadrant-operator-catalog-69d4g\" (UID: \"576cad45-6e5b-4cdc-a701-add2e4781dc1\") " pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:37.017797 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.017760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vr8n\" (UniqueName: \"kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n\") pod \"kuadrant-operator-catalog-69d4g\" (UID: \"576cad45-6e5b-4cdc-a701-add2e4781dc1\") " pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:37.027405 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.027371 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vr8n\" (UniqueName: \"kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n\") pod \"kuadrant-operator-catalog-69d4g\" (UID: \"576cad45-6e5b-4cdc-a701-add2e4781dc1\") " pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:37.119083 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.119046 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:37.119289 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.119274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:37.258387 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.258361 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:37.260276 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:07:37.260250 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod576cad45_6e5b_4cdc_a701_add2e4781dc1.slice/crio-8abb62113fe4bdb5fbdc633db00065157ae3b6c25107851afedf1ec98142591f WatchSource:0}: Error finding container 8abb62113fe4bdb5fbdc633db00065157ae3b6c25107851afedf1ec98142591f: Status 404 returned error can't find the container with id 8abb62113fe4bdb5fbdc633db00065157ae3b6c25107851afedf1ec98142591f Jul 17 10:07:37.332747 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.332650 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcxhg"] Jul 17 10:07:37.337317 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.337289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:37.346105 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.346076 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcxhg"] Jul 17 10:07:37.370943 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.370879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" event={"ID":"576cad45-6e5b-4cdc-a701-add2e4781dc1","Type":"ContainerStarted","Data":"8abb62113fe4bdb5fbdc633db00065157ae3b6c25107851afedf1ec98142591f"} Jul 17 10:07:37.421501 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.421459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hz72\" (UniqueName: \"kubernetes.io/projected/ea550eb5-57ce-4832-88c5-e63f0e564617-kube-api-access-4hz72\") pod \"kuadrant-operator-catalog-mcxhg\" (UID: \"ea550eb5-57ce-4832-88c5-e63f0e564617\") " pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:37.522480 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.522443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hz72\" (UniqueName: \"kubernetes.io/projected/ea550eb5-57ce-4832-88c5-e63f0e564617-kube-api-access-4hz72\") pod \"kuadrant-operator-catalog-mcxhg\" (UID: \"ea550eb5-57ce-4832-88c5-e63f0e564617\") " pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:37.533120 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.533079 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hz72\" (UniqueName: \"kubernetes.io/projected/ea550eb5-57ce-4832-88c5-e63f0e564617-kube-api-access-4hz72\") pod \"kuadrant-operator-catalog-mcxhg\" (UID: \"ea550eb5-57ce-4832-88c5-e63f0e564617\") " pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:37.648155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.648065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:37.801512 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:37.801489 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mcxhg"] Jul 17 10:07:37.803680 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:07:37.803655 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea550eb5_57ce_4832_88c5_e63f0e564617.slice/crio-d5c01eade1976cde3d3ce222a6eeba91572e9363c8dd830f60ad56379e023f6e WatchSource:0}: Error finding container d5c01eade1976cde3d3ce222a6eeba91572e9363c8dd830f60ad56379e023f6e: Status 404 returned error can't find the container with id d5c01eade1976cde3d3ce222a6eeba91572e9363c8dd830f60ad56379e023f6e Jul 17 10:07:38.378239 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:38.378188 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" event={"ID":"ea550eb5-57ce-4832-88c5-e63f0e564617","Type":"ContainerStarted","Data":"d5c01eade1976cde3d3ce222a6eeba91572e9363c8dd830f60ad56379e023f6e"} Jul 17 10:07:40.391480 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.391385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" event={"ID":"ea550eb5-57ce-4832-88c5-e63f0e564617","Type":"ContainerStarted","Data":"e4ecb160ea6421de60b0ad8d722abafe7479bd0a29dd9dd0894a9a5ed49b195b"} Jul 17 10:07:40.392948 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.392912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" event={"ID":"576cad45-6e5b-4cdc-a701-add2e4781dc1","Type":"ContainerStarted","Data":"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b"} Jul 17 10:07:40.393057 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.392944 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" podUID="576cad45-6e5b-4cdc-a701-add2e4781dc1" containerName="registry-server" containerID="cri-o://d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b" gracePeriod=2 Jul 17 10:07:40.413449 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.413404 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" podStartSLOduration=1.187513087 podStartE2EDuration="3.413388671s" totalImagesPullingTime="2.225875584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:07:40.411867199 +0000 UTC m=+417.556443771" watchObservedRunningTime="2026-07-17 10:07:40.413388671 +0000 UTC m=+417.557965240" Jul 17 10:07:40.434767 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.434710 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" podStartSLOduration=2.092116367 podStartE2EDuration="4.434689788s" totalImagesPullingTime="2.342573421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:07:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:07:40.433650444 +0000 UTC m=+417.578227013" watchObservedRunningTime="2026-07-17 10:07:40.434689788 +0000 UTC m=+417.579266355" Jul 17 10:07:40.640094 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.640065 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:40.653065 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.652987 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vr8n\" (UniqueName: \"kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n\") pod \"576cad45-6e5b-4cdc-a701-add2e4781dc1\" (UID: \"576cad45-6e5b-4cdc-a701-add2e4781dc1\") " Jul 17 10:07:40.655175 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.655148 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n" (OuterVolumeSpecName: "kube-api-access-5vr8n") pod "576cad45-6e5b-4cdc-a701-add2e4781dc1" (UID: "576cad45-6e5b-4cdc-a701-add2e4781dc1"). InnerVolumeSpecName "kube-api-access-5vr8n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:07:40.754351 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:40.754312 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vr8n\" (UniqueName: \"kubernetes.io/projected/576cad45-6e5b-4cdc-a701-add2e4781dc1-kube-api-access-5vr8n\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:07:41.398715 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.398682 2562 generic.go:356] "Generic (PLEG): container finished" podID="576cad45-6e5b-4cdc-a701-add2e4781dc1" containerID="d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b" exitCode=0 Jul 17 10:07:41.399193 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.398723 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" Jul 17 10:07:41.399193 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.398764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" event={"ID":"576cad45-6e5b-4cdc-a701-add2e4781dc1","Type":"ContainerDied","Data":"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b"} Jul 17 10:07:41.399193 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.398809 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-69d4g" event={"ID":"576cad45-6e5b-4cdc-a701-add2e4781dc1","Type":"ContainerDied","Data":"8abb62113fe4bdb5fbdc633db00065157ae3b6c25107851afedf1ec98142591f"} Jul 17 10:07:41.399193 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.398833 2562 scope.go:117] "RemoveContainer" containerID="d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b" Jul 17 10:07:41.407693 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.407674 2562 scope.go:117] "RemoveContainer" containerID="d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b" Jul 17 10:07:41.407999 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:07:41.407976 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b\": container with ID starting with d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b not found: ID does not exist" containerID="d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b" Jul 17 10:07:41.408062 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.408012 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b"} err="failed to get container status \"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b\": rpc error: code = NotFound desc = could not find container \"d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b\": container with ID starting with d8177ae91eda73a37c253d97e51578c68e8641fdc2d36a32874887c317bdb79b not found: ID does not exist" Jul 17 10:07:41.421820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.421798 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:41.425527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:41.425508 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-69d4g"] Jul 17 10:07:42.545614 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:42.545581 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="576cad45-6e5b-4cdc-a701-add2e4781dc1" path="/var/lib/kubelet/pods/576cad45-6e5b-4cdc-a701-add2e4781dc1/volumes" Jul 17 10:07:47.648524 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:47.648476 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:47.649066 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:47.648553 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:47.670773 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:47.670747 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:07:48.453188 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:07:48.453155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mcxhg" Jul 17 10:08:06.319881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:06.319787 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:08.914202 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.914165 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g"] Jul 17 10:08:08.914566 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.914499 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="576cad45-6e5b-4cdc-a701-add2e4781dc1" containerName="registry-server" Jul 17 10:08:08.914566 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.914510 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="576cad45-6e5b-4cdc-a701-add2e4781dc1" containerName="registry-server" Jul 17 10:08:08.914644 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.914590 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="576cad45-6e5b-4cdc-a701-add2e4781dc1" containerName="registry-server" Jul 17 10:08:08.917755 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.917737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:08.920406 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.920383 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n9rgt\"" Jul 17 10:08:08.931858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.931836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g"] Jul 17 10:08:08.984919 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:08.984861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vdc\" (UniqueName: \"kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" (UID: \"badb950d-3e43-49e6-90b1-1bfe1a95861c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:09.086059 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.086019 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vdc\" (UniqueName: \"kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" (UID: \"badb950d-3e43-49e6-90b1-1bfe1a95861c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:09.104924 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.104881 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vdc\" (UniqueName: \"kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc\") pod \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" (UID: \"badb950d-3e43-49e6-90b1-1bfe1a95861c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:09.228164 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.228077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:09.367366 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.367341 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g"] Jul 17 10:08:09.370076 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:09.370048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadb950d_3e43_49e6_90b1_1bfe1a95861c.slice/crio-9573b1d873277cf32ba1b5ff984831af85ea57f7852f49b597bc48784353c295 WatchSource:0}: Error finding container 9573b1d873277cf32ba1b5ff984831af85ea57f7852f49b597bc48784353c295: Status 404 returned error can't find the container with id 9573b1d873277cf32ba1b5ff984831af85ea57f7852f49b597bc48784353c295 Jul 17 10:08:09.523391 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.523355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" event={"ID":"badb950d-3e43-49e6-90b1-1bfe1a95861c","Type":"ContainerStarted","Data":"9573b1d873277cf32ba1b5ff984831af85ea57f7852f49b597bc48784353c295"} Jul 17 10:08:09.772493 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:09.772452 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:10.002091 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:10.002041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:11.535129 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:11.535089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" event={"ID":"badb950d-3e43-49e6-90b1-1bfe1a95861c","Type":"ContainerStarted","Data":"ada2aec8a767358b327b1059885f41d6a6c6e5657568d9edd0902db57a05b5b8"} Jul 17 10:08:11.535484 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:11.535161 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:11.580950 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:11.580882 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" podStartSLOduration=1.8866649450000001 podStartE2EDuration="3.58086524s" totalImagesPullingTime="1.694200295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:11.579814562 +0000 UTC m=+448.724391133" watchObservedRunningTime="2026-07-17 10:08:11.58086524 +0000 UTC m=+448.725441810" Jul 17 10:08:14.045859 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.045826 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg"] Jul 17 10:08:14.053753 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.053726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.056635 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.056612 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5cpfv\"" Jul 17 10:08:14.067288 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.067265 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg"] Jul 17 10:08:14.130294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.130262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.130294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.130305 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt68l\" (UniqueName: \"kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.231282 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.231241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.231450 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.231296 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt68l\" (UniqueName: \"kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.231641 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.231622 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.242309 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.242285 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt68l\" (UniqueName: \"kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.363937 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.363828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:14.438423 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.438391 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:14.530063 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.530027 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg"] Jul 17 10:08:14.532953 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:14.532924 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4547efd_02d5_4d98_936f_9b605f3ada13.slice/crio-e4cffe5bd49fc51ff460f1d7a4feddad45e8786e65836bdaabc54d20a5974525 WatchSource:0}: Error finding container e4cffe5bd49fc51ff460f1d7a4feddad45e8786e65836bdaabc54d20a5974525: Status 404 returned error can't find the container with id e4cffe5bd49fc51ff460f1d7a4feddad45e8786e65836bdaabc54d20a5974525 Jul 17 10:08:14.550149 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:14.550115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" event={"ID":"e4547efd-02d5-4d98-936f-9b605f3ada13","Type":"ContainerStarted","Data":"e4cffe5bd49fc51ff460f1d7a4feddad45e8786e65836bdaabc54d20a5974525"} Jul 17 10:08:15.035294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:15.035263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:15.336993 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:15.336877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:17.173732 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.173683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:17.727609 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.727577 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx"] Jul 17 10:08:17.731467 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.731444 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:17.734433 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.734412 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dxgdv\"" Jul 17 10:08:17.747685 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.747654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx"] Jul 17 10:08:17.863737 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.863697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4x7\" (UniqueName: \"kubernetes.io/projected/41aea090-5229-46c0-b478-d0f93d83113e-kube-api-access-np4x7\") pod \"authorino-operator-75cc8d5cb7-mfbjx\" (UID: \"41aea090-5229-46c0-b478-d0f93d83113e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:17.965175 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.965129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4x7\" (UniqueName: \"kubernetes.io/projected/41aea090-5229-46c0-b478-d0f93d83113e-kube-api-access-np4x7\") pod \"authorino-operator-75cc8d5cb7-mfbjx\" (UID: \"41aea090-5229-46c0-b478-d0f93d83113e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:17.977848 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:17.977775 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4x7\" (UniqueName: \"kubernetes.io/projected/41aea090-5229-46c0-b478-d0f93d83113e-kube-api-access-np4x7\") pod \"authorino-operator-75cc8d5cb7-mfbjx\" (UID: \"41aea090-5229-46c0-b478-d0f93d83113e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:18.043288 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:18.043249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:18.197565 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:18.197534 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx"] Jul 17 10:08:18.200524 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:18.200490 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41aea090_5229_46c0_b478_d0f93d83113e.slice/crio-608ec4a96693d2ce8abac9d0ab65558e9e91f2fb7c918599ebcd3b164c84ff5a WatchSource:0}: Error finding container 608ec4a96693d2ce8abac9d0ab65558e9e91f2fb7c918599ebcd3b164c84ff5a: Status 404 returned error can't find the container with id 608ec4a96693d2ce8abac9d0ab65558e9e91f2fb7c918599ebcd3b164c84ff5a Jul 17 10:08:18.576839 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:18.576806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" event={"ID":"41aea090-5229-46c0-b478-d0f93d83113e","Type":"ContainerStarted","Data":"608ec4a96693d2ce8abac9d0ab65558e9e91f2fb7c918599ebcd3b164c84ff5a"} Jul 17 10:08:18.849295 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:18.849157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:19.711127 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:19.711078 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:21.109699 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.109654 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4"] Jul 17 10:08:21.113763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.113741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:21.117225 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.117189 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-knghh\"" Jul 17 10:08:21.118711 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.118633 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 17 10:08:21.138525 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.138499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4"] Jul 17 10:08:21.195343 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.195302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4hbd\" (UniqueName: \"kubernetes.io/projected/0cca839e-6ea5-4faf-8292-5759a8dd2ca4-kube-api-access-k4hbd\") pod \"dns-operator-controller-manager-864dd78c4c-jz9x4\" (UID: \"0cca839e-6ea5-4faf-8292-5759a8dd2ca4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:21.296516 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.296474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4hbd\" (UniqueName: \"kubernetes.io/projected/0cca839e-6ea5-4faf-8292-5759a8dd2ca4-kube-api-access-k4hbd\") pod \"dns-operator-controller-manager-864dd78c4c-jz9x4\" (UID: \"0cca839e-6ea5-4faf-8292-5759a8dd2ca4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:21.309686 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.309652 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4hbd\" (UniqueName: \"kubernetes.io/projected/0cca839e-6ea5-4faf-8292-5759a8dd2ca4-kube-api-access-k4hbd\") pod \"dns-operator-controller-manager-864dd78c4c-jz9x4\" (UID: \"0cca839e-6ea5-4faf-8292-5759a8dd2ca4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:21.426492 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.426399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:21.691121 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.691092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:21.764577 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:21.764555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4"] Jul 17 10:08:21.767116 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:21.767091 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cca839e_6ea5_4faf_8292_5759a8dd2ca4.slice/crio-89f067e507ad15986fb1efa5f952b1d2215bbbca2f1e628f51a80a9d1d2e3eb9 WatchSource:0}: Error finding container 89f067e507ad15986fb1efa5f952b1d2215bbbca2f1e628f51a80a9d1d2e3eb9: Status 404 returned error can't find the container with id 89f067e507ad15986fb1efa5f952b1d2215bbbca2f1e628f51a80a9d1d2e3eb9 Jul 17 10:08:22.545811 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.545783 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:22.618378 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.618335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" event={"ID":"e4547efd-02d5-4d98-936f-9b605f3ada13","Type":"ContainerStarted","Data":"dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c"} Jul 17 10:08:22.618614 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.618485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:22.620272 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.620232 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" event={"ID":"41aea090-5229-46c0-b478-d0f93d83113e","Type":"ContainerStarted","Data":"19e4f7ea922e7499a249876b32d1f295cf71b37b2dc23746240c3414e136ce5b"} Jul 17 10:08:22.620390 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.620342 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:22.621786 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.621759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" event={"ID":"0cca839e-6ea5-4faf-8292-5759a8dd2ca4","Type":"ContainerStarted","Data":"89f067e507ad15986fb1efa5f952b1d2215bbbca2f1e628f51a80a9d1d2e3eb9"} Jul 17 10:08:22.685835 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.685781 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" podStartSLOduration=2.269323911 podStartE2EDuration="5.68576301s" totalImagesPullingTime="3.416439099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:22.685207992 +0000 UTC m=+459.829784545" watchObservedRunningTime="2026-07-17 10:08:22.68576301 +0000 UTC m=+459.830339643" Jul 17 10:08:22.686601 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:22.686566 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" podStartSLOduration=1.5835397439999999 podStartE2EDuration="8.686557839s" totalImagesPullingTime="7.103018095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:22.646600733 +0000 UTC m=+459.791177303" watchObservedRunningTime="2026-07-17 10:08:22.686557839 +0000 UTC m=+459.831134433" Jul 17 10:08:23.104104 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:23.104065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:23.294859 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:23.294823 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:24.634579 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:24.634542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" event={"ID":"0cca839e-6ea5-4faf-8292-5759a8dd2ca4","Type":"ContainerStarted","Data":"c061a7c07d09343c3f4f5cdf309b65cf63a001a3d5d39a6f9ce72eb198eb6019"} Jul 17 10:08:24.635017 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:24.634660 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:24.658732 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:24.658677 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" podStartSLOduration=1.511057632 podStartE2EDuration="3.658660972s" totalImagesPullingTime="2.14760334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:24.656473402 +0000 UTC m=+461.801049973" watchObservedRunningTime="2026-07-17 10:08:24.658660972 +0000 UTC m=+461.803237542" Jul 17 10:08:24.946031 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:24.945939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:25.282743 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:25.282694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:26.666988 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:26.666958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:26.813312 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:26.813269 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:33.629823 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:33.629779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:33.630214 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:33.629875 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mfbjx" Jul 17 10:08:35.062678 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.062639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:35.160790 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.160748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:35.406385 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.406297 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg"] Jul 17 10:08:35.406638 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.406498 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" containerName="manager" containerID="cri-o://dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c" gracePeriod=2 Jul 17 10:08:35.413769 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.413740 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg"] Jul 17 10:08:35.434076 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.434045 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g"] Jul 17 10:08:35.434373 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.434294 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" containerName="manager" containerID="cri-o://ada2aec8a767358b327b1059885f41d6a6c6e5657568d9edd0902db57a05b5b8" gracePeriod=2 Jul 17 10:08:35.437824 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.437786 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.478352 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.478312 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"badb950d-3e43-49e6-90b1-1bfe1a95861c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-6wl4g\": pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.483815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.483786 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g"] Jul 17 10:08:35.485877 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.485855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:35.486232 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486217 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" containerName="manager" Jul 17 10:08:35.486232 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486231 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" containerName="manager" Jul 17 10:08:35.486442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486247 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" containerName="manager" Jul 17 10:08:35.486442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486257 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" containerName="manager" Jul 17 10:08:35.486442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486343 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" containerName="manager" Jul 17 10:08:35.486442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.486357 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" containerName="manager" Jul 17 10:08:35.489344 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.489327 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.507792 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.507769 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb"] Jul 17 10:08:35.511170 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.511147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:35.521409 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.521369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7lv\" (UniqueName: \"kubernetes.io/projected/7fafad9b-edbb-41ab-9b28-249525a7d409-kube-api-access-sl7lv\") pod \"limitador-operator-controller-manager-859d7b78bd-nt7sb\" (UID: \"7fafad9b-edbb-41ab-9b28-249525a7d409\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:35.521532 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.521428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kv9b\" (UniqueName: \"kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.521532 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.521470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.545813 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.545781 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.548974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.548867 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb"] Jul 17 10:08:35.550731 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.550686 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.559098 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.559065 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.595205 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.595175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:35.603144 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.603101 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.622391 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.622359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7lv\" (UniqueName: \"kubernetes.io/projected/7fafad9b-edbb-41ab-9b28-249525a7d409-kube-api-access-sl7lv\") pod \"limitador-operator-controller-manager-859d7b78bd-nt7sb\" (UID: \"7fafad9b-edbb-41ab-9b28-249525a7d409\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:35.622527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.622452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kv9b\" (UniqueName: \"kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.622527 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.622493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.622944 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.622920 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.641482 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.641448 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7lv\" (UniqueName: \"kubernetes.io/projected/7fafad9b-edbb-41ab-9b28-249525a7d409-kube-api-access-sl7lv\") pod \"limitador-operator-controller-manager-859d7b78bd-nt7sb\" (UID: \"7fafad9b-edbb-41ab-9b28-249525a7d409\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:35.642142 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.642118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jz9x4" Jul 17 10:08:35.650254 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.650225 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kv9b\" (UniqueName: \"kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jn2p5\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.688484 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.688350 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.695209 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.694243 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.699795 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.699770 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.700567 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.700465 2562 generic.go:356] "Generic (PLEG): container finished" podID="badb950d-3e43-49e6-90b1-1bfe1a95861c" containerID="ada2aec8a767358b327b1059885f41d6a6c6e5657568d9edd0902db57a05b5b8" exitCode=0 Jul 17 10:08:35.702162 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.702134 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.702315 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.702297 2562 generic.go:356] "Generic (PLEG): container finished" podID="e4547efd-02d5-4d98-936f-9b605f3ada13" containerID="dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c" exitCode=0 Jul 17 10:08:35.702399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.702346 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.702458 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.702353 2562 scope.go:117] "RemoveContainer" containerID="dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c" Jul 17 10:08:35.705802 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.705679 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.705939 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.705892 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.707663 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.707637 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.709450 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.709419 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.711914 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.711881 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:35.712533 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.712495 2562 scope.go:117] "RemoveContainer" containerID="dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c" Jul 17 10:08:35.712868 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.712847 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c\": container with ID starting with dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c not found: ID does not exist" containerID="dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c" Jul 17 10:08:35.712982 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.712875 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c"} err="failed to get container status \"dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c\": rpc error: code = NotFound desc = could not find container \"dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c\": container with ID starting with dbdc208e0666d728a8651fa1d0385d4e55cc4e652b712c07f7acf40461deaf7c not found: ID does not exist" Jul 17 10:08:35.713957 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:35.713930 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:35.723158 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.723138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4vdc\" (UniqueName: \"kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc\") pod \"badb950d-3e43-49e6-90b1-1bfe1a95861c\" (UID: \"badb950d-3e43-49e6-90b1-1bfe1a95861c\") " Jul 17 10:08:35.723244 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.723185 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume\") pod \"e4547efd-02d5-4d98-936f-9b605f3ada13\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " Jul 17 10:08:35.723244 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.723206 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bt68l\" (UniqueName: \"kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l\") pod \"e4547efd-02d5-4d98-936f-9b605f3ada13\" (UID: \"e4547efd-02d5-4d98-936f-9b605f3ada13\") " Jul 17 10:08:35.723674 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.723645 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4547efd-02d5-4d98-936f-9b605f3ada13" (UID: "e4547efd-02d5-4d98-936f-9b605f3ada13"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 10:08:35.725117 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.725097 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc" (OuterVolumeSpecName: "kube-api-access-d4vdc") pod "badb950d-3e43-49e6-90b1-1bfe1a95861c" (UID: "badb950d-3e43-49e6-90b1-1bfe1a95861c"). InnerVolumeSpecName "kube-api-access-d4vdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:08:35.725249 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.725233 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l" (OuterVolumeSpecName: "kube-api-access-bt68l") pod "e4547efd-02d5-4d98-936f-9b605f3ada13" (UID: "e4547efd-02d5-4d98-936f-9b605f3ada13"). InnerVolumeSpecName "kube-api-access-bt68l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:08:35.824159 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.824123 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4vdc\" (UniqueName: \"kubernetes.io/projected/badb950d-3e43-49e6-90b1-1bfe1a95861c-kube-api-access-d4vdc\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:08:35.824159 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.824151 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4547efd-02d5-4d98-936f-9b605f3ada13-extensions-socket-volume\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:08:35.824159 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.824164 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bt68l\" (UniqueName: \"kubernetes.io/projected/e4547efd-02d5-4d98-936f-9b605f3ada13-kube-api-access-bt68l\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:08:35.853946 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.853892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:35.861324 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:35.861304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:36.005332 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.005229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:36.008393 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:36.008370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3092650_6b33_4eb4_94a9_2c03f264f282.slice/crio-83f48d2e8a94e0aadcb28ee6ae1126f1121340e559be1571da0deb15e315e69b WatchSource:0}: Error finding container 83f48d2e8a94e0aadcb28ee6ae1126f1121340e559be1571da0deb15e315e69b: Status 404 returned error can't find the container with id 83f48d2e8a94e0aadcb28ee6ae1126f1121340e559be1571da0deb15e315e69b Jul 17 10:08:36.013361 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:36.013333 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-6wl4g\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:36.015529 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:36.015504 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4zlwg\" is forbidden: User \"system:node:ip-10-0-128-133.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-133.ec2.internal' and this object" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4zlwg" Jul 17 10:08:36.021887 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.021864 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb"] Jul 17 10:08:36.024675 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:36.024655 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fafad9b_edbb_41ab_9b28_249525a7d409.slice/crio-4889b373828910f9e3527672b6392b50ec5186d928850a3887754e9082194197 WatchSource:0}: Error finding container 4889b373828910f9e3527672b6392b50ec5186d928850a3887754e9082194197: Status 404 returned error can't find the container with id 4889b373828910f9e3527672b6392b50ec5186d928850a3887754e9082194197 Jul 17 10:08:36.546331 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.546295 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="badb950d-3e43-49e6-90b1-1bfe1a95861c" path="/var/lib/kubelet/pods/badb950d-3e43-49e6-90b1-1bfe1a95861c/volumes" Jul 17 10:08:36.546686 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.546638 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4547efd-02d5-4d98-936f-9b605f3ada13" path="/var/lib/kubelet/pods/e4547efd-02d5-4d98-936f-9b605f3ada13/volumes" Jul 17 10:08:36.667567 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.667532 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz"] Jul 17 10:08:36.671186 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.671163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.682443 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.682384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz"] Jul 17 10:08:36.709739 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.709704 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" event={"ID":"d3092650-6b33-4eb4-94a9-2c03f264f282","Type":"ContainerStarted","Data":"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a"} Jul 17 10:08:36.709920 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.709757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" event={"ID":"d3092650-6b33-4eb4-94a9-2c03f264f282","Type":"ContainerStarted","Data":"83f48d2e8a94e0aadcb28ee6ae1126f1121340e559be1571da0deb15e315e69b"} Jul 17 10:08:36.709920 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.709831 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:36.711138 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.711119 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6wl4g" Jul 17 10:08:36.711138 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.711130 2562 scope.go:117] "RemoveContainer" containerID="ada2aec8a767358b327b1059885f41d6a6c6e5657568d9edd0902db57a05b5b8" Jul 17 10:08:36.712849 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.712807 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" event={"ID":"7fafad9b-edbb-41ab-9b28-249525a7d409","Type":"ContainerStarted","Data":"788130bfdbd4c301f2b5434f43752e25190b4ee9ecefe8a588857ef2aed64e5e"} Jul 17 10:08:36.712974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.712884 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:36.712974 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.712934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" event={"ID":"7fafad9b-edbb-41ab-9b28-249525a7d409","Type":"ContainerStarted","Data":"4889b373828910f9e3527672b6392b50ec5186d928850a3887754e9082194197"} Jul 17 10:08:36.730303 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.730277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.730436 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.730342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vss\" (UniqueName: \"kubernetes.io/projected/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-kube-api-access-j6vss\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.731713 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.731669 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" podStartSLOduration=1.731655882 podStartE2EDuration="1.731655882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:36.729026195 +0000 UTC m=+473.873602765" watchObservedRunningTime="2026-07-17 10:08:36.731655882 +0000 UTC m=+473.876232508" Jul 17 10:08:36.750470 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.750423 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" podStartSLOduration=1.750405929 podStartE2EDuration="1.750405929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:36.749818966 +0000 UTC m=+473.894395536" watchObservedRunningTime="2026-07-17 10:08:36.750405929 +0000 UTC m=+473.894982499" Jul 17 10:08:36.831747 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.831709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vss\" (UniqueName: \"kubernetes.io/projected/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-kube-api-access-j6vss\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.831878 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.831806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.832217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.832198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.844151 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.844125 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vss\" (UniqueName: \"kubernetes.io/projected/5644ec3c-c2cb-4337-a053-8e2f3b2f0be2-kube-api-access-j6vss\") pod \"kuadrant-operator-controller-manager-86878c769f-rfmsz\" (UID: \"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:36.982533 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:36.982442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:37.129042 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.129014 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz"] Jul 17 10:08:37.132121 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:08:37.132098 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5644ec3c_c2cb_4337_a053_8e2f3b2f0be2.slice/crio-9308a8b124b79741360e81dd9759f4c38a2712abe18c7bb154e5be2a73dc8d25 WatchSource:0}: Error finding container 9308a8b124b79741360e81dd9759f4c38a2712abe18c7bb154e5be2a73dc8d25: Status 404 returned error can't find the container with id 9308a8b124b79741360e81dd9759f4c38a2712abe18c7bb154e5be2a73dc8d25 Jul 17 10:08:37.528070 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.527997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:37.627147 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.627106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:37.719036 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.718996 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" event={"ID":"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2","Type":"ContainerStarted","Data":"f120fa2cd6fa1f857bc8cd0780ddf71875b3527006a9363c7734007eb91a7494"} Jul 17 10:08:37.719191 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.719052 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" event={"ID":"5644ec3c-c2cb-4337-a053-8e2f3b2f0be2","Type":"ContainerStarted","Data":"9308a8b124b79741360e81dd9759f4c38a2712abe18c7bb154e5be2a73dc8d25"} Jul 17 10:08:37.719191 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.719102 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:37.742311 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:37.742263 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" podStartSLOduration=1.742246543 podStartE2EDuration="1.742246543s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:08:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:08:37.73982042 +0000 UTC m=+474.884396990" watchObservedRunningTime="2026-07-17 10:08:37.742246543 +0000 UTC m=+474.886823114" Jul 17 10:08:40.407340 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:40.407301 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:41.951763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:41.951725 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:42.050419 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:42.050381 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:44.089525 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:44.089482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:44.189519 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:44.189481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:47.722510 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:47.722473 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nt7sb" Jul 17 10:08:47.722969 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:47.722563 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:48.727354 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:48.727325 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rfmsz" Jul 17 10:08:48.806571 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:48.806537 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:48.806751 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:48.806729 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" podUID="d3092650-6b33-4eb4-94a9-2c03f264f282" containerName="manager" containerID="cri-o://2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a" gracePeriod=10 Jul 17 10:08:49.074174 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.074149 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:49.150567 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.150536 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kv9b\" (UniqueName: \"kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b\") pod \"d3092650-6b33-4eb4-94a9-2c03f264f282\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " Jul 17 10:08:49.150733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.150597 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume\") pod \"d3092650-6b33-4eb4-94a9-2c03f264f282\" (UID: \"d3092650-6b33-4eb4-94a9-2c03f264f282\") " Jul 17 10:08:49.151103 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.151067 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3092650-6b33-4eb4-94a9-2c03f264f282" (UID: "d3092650-6b33-4eb4-94a9-2c03f264f282"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 10:08:49.152684 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.152661 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b" (OuterVolumeSpecName: "kube-api-access-6kv9b") pod "d3092650-6b33-4eb4-94a9-2c03f264f282" (UID: "d3092650-6b33-4eb4-94a9-2c03f264f282"). InnerVolumeSpecName "kube-api-access-6kv9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:08:49.251466 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.251433 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kv9b\" (UniqueName: \"kubernetes.io/projected/d3092650-6b33-4eb4-94a9-2c03f264f282-kube-api-access-6kv9b\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:08:49.251466 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.251464 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3092650-6b33-4eb4-94a9-2c03f264f282-extensions-socket-volume\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:08:49.778997 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.778964 2562 generic.go:356] "Generic (PLEG): container finished" podID="d3092650-6b33-4eb4-94a9-2c03f264f282" containerID="2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a" exitCode=0 Jul 17 10:08:49.779410 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.779005 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" event={"ID":"d3092650-6b33-4eb4-94a9-2c03f264f282","Type":"ContainerDied","Data":"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a"} Jul 17 10:08:49.779410 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.779011 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" Jul 17 10:08:49.779410 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.779048 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5" event={"ID":"d3092650-6b33-4eb4-94a9-2c03f264f282","Type":"ContainerDied","Data":"83f48d2e8a94e0aadcb28ee6ae1126f1121340e559be1571da0deb15e315e69b"} Jul 17 10:08:49.779410 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.779069 2562 scope.go:117] "RemoveContainer" containerID="2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a" Jul 17 10:08:49.788227 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.788209 2562 scope.go:117] "RemoveContainer" containerID="2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a" Jul 17 10:08:49.788474 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:08:49.788455 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a\": container with ID starting with 2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a not found: ID does not exist" containerID="2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a" Jul 17 10:08:49.788532 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.788481 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a"} err="failed to get container status \"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a\": rpc error: code = NotFound desc = could not find container \"2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a\": container with ID starting with 2fb457c15ee18ba893f57a687083bad19d977601112466df1ec7b1f2b7cd226a not found: ID does not exist" Jul 17 10:08:49.817017 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.816981 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:49.822939 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:49.822916 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jn2p5"] Jul 17 10:08:50.545844 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:50.545810 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3092650-6b33-4eb4-94a9-2c03f264f282" path="/var/lib/kubelet/pods/d3092650-6b33-4eb4-94a9-2c03f264f282/volumes" Jul 17 10:08:52.923539 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:52.923501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:53.020627 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:53.020589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:53.121692 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:53.121657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:55.347266 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:55.347205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:55.417952 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:55.417891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:56.388181 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:56.388146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:56.488600 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:56.488568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:59.706374 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:59.706339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:08:59.805223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:08:59.805181 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:03.519723 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:03.519685 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:03.576713 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:03.576634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:05.359285 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:05.359241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:05.487066 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:05.487035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:07.119833 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.119792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:07.125846 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.125821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:07.126229 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.126215 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3092650-6b33-4eb4-94a9-2c03f264f282" containerName="manager" Jul 17 10:09:07.126283 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.126231 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3092650-6b33-4eb4-94a9-2c03f264f282" containerName="manager" Jul 17 10:09:07.126319 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.126307 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3092650-6b33-4eb4-94a9-2c03f264f282" containerName="manager" Jul 17 10:09:07.129341 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.129322 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.131607 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.131585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 10:09:07.131690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.131639 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7pdb9\"" Jul 17 10:09:07.143225 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.143200 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:07.212429 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.212387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.212589 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.212440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q85g\" (UniqueName: \"kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.222011 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.221886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:07.223091 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.223058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:07.313414 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.313379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.313602 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.313428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q85g\" (UniqueName: \"kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.314085 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.314062 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.321547 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.321514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:07.321769 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.321751 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q85g\" (UniqueName: \"kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g\") pod \"limitador-limitador-64c94fd64f-v7qll\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.439453 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.439361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:07.611881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.611845 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:07.612973 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:09:07.612945 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e990e1_ce81_4f39_b0ff_cd3c91874950.slice/crio-fcbe0eb71ca816253fc50a053ddd69ca726d396424a7aa1f91215b22e522740f WatchSource:0}: Error finding container fcbe0eb71ca816253fc50a053ddd69ca726d396424a7aa1f91215b22e522740f: Status 404 returned error can't find the container with id fcbe0eb71ca816253fc50a053ddd69ca726d396424a7aa1f91215b22e522740f Jul 17 10:09:07.865341 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:07.865305 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" event={"ID":"57e990e1-ce81-4f39-b0ff-cd3c91874950","Type":"ContainerStarted","Data":"fcbe0eb71ca816253fc50a053ddd69ca726d396424a7aa1f91215b22e522740f"} Jul 17 10:09:08.047223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.047195 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:08.051881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.051855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:08.054404 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.054379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hrxvz\"" Jul 17 10:09:08.058200 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.058177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:08.071530 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.071500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:08.172186 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.172096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:08.222146 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.222107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz\") pod \"authorino-58cd955675-jtvk2\" (UID: \"f76c17c0-b6c6-42e0-b02f-940718a74be5\") " pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:08.322734 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.322700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz\") pod \"authorino-58cd955675-jtvk2\" (UID: \"f76c17c0-b6c6-42e0-b02f-940718a74be5\") " pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:08.331520 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.331491 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz\") pod \"authorino-58cd955675-jtvk2\" (UID: \"f76c17c0-b6c6-42e0-b02f-940718a74be5\") " pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:08.363246 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.363209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:08.502333 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.502301 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:08.504711 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:09:08.504681 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf76c17c0_b6c6_42e0_b02f_940718a74be5.slice/crio-ee6889b6163fb5f85626e62304352d3c60ae16be95f398afc456ec262e76aff9 WatchSource:0}: Error finding container ee6889b6163fb5f85626e62304352d3c60ae16be95f398afc456ec262e76aff9: Status 404 returned error can't find the container with id ee6889b6163fb5f85626e62304352d3c60ae16be95f398afc456ec262e76aff9 Jul 17 10:09:08.873684 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:08.873644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jtvk2" event={"ID":"f76c17c0-b6c6-42e0-b02f-940718a74be5","Type":"ContainerStarted","Data":"ee6889b6163fb5f85626e62304352d3c60ae16be95f398afc456ec262e76aff9"} Jul 17 10:09:12.900608 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:12.900561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" event={"ID":"57e990e1-ce81-4f39-b0ff-cd3c91874950","Type":"ContainerStarted","Data":"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4"} Jul 17 10:09:12.901064 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:12.900741 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:12.902111 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:12.902087 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jtvk2" event={"ID":"f76c17c0-b6c6-42e0-b02f-940718a74be5","Type":"ContainerStarted","Data":"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc"} Jul 17 10:09:12.920627 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:12.920579 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" podStartSLOduration=1.145104288 podStartE2EDuration="5.920563758s" totalImagesPullingTime="4.77545947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:12.919134933 +0000 UTC m=+510.063711503" watchObservedRunningTime="2026-07-17 10:09:12.920563758 +0000 UTC m=+510.065140329" Jul 17 10:09:12.935401 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:12.935349 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jtvk2" podStartSLOduration=1.051410635 podStartE2EDuration="4.935332014s" totalImagesPullingTime="3.883921379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:12.933640351 +0000 UTC m=+510.078216921" watchObservedRunningTime="2026-07-17 10:09:12.935332014 +0000 UTC m=+510.079908583" Jul 17 10:09:13.208481 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:13.208402 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:13.731446 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:13.731393 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:13.831917 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:13.831878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:13.936005 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:13.935970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:14.041314 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:14.041276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:14.912478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:14.912432 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jtvk2" podUID="f76c17c0-b6c6-42e0-b02f-940718a74be5" containerName="authorino" containerID="cri-o://a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc" gracePeriod=30 Jul 17 10:09:15.158621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.158594 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:15.186746 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.186666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz\") pod \"f76c17c0-b6c6-42e0-b02f-940718a74be5\" (UID: \"f76c17c0-b6c6-42e0-b02f-940718a74be5\") " Jul 17 10:09:15.188840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.188801 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz" (OuterVolumeSpecName: "kube-api-access-ctzsz") pod "f76c17c0-b6c6-42e0-b02f-940718a74be5" (UID: "f76c17c0-b6c6-42e0-b02f-940718a74be5"). InnerVolumeSpecName "kube-api-access-ctzsz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:09:15.287488 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.287448 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctzsz\" (UniqueName: \"kubernetes.io/projected/f76c17c0-b6c6-42e0-b02f-940718a74be5-kube-api-access-ctzsz\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:09:15.734690 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.734635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:15.918465 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.918424 2562 generic.go:356] "Generic (PLEG): container finished" podID="f76c17c0-b6c6-42e0-b02f-940718a74be5" containerID="a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc" exitCode=0 Jul 17 10:09:15.918465 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.918464 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jtvk2" Jul 17 10:09:15.918714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.918478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jtvk2" event={"ID":"f76c17c0-b6c6-42e0-b02f-940718a74be5","Type":"ContainerDied","Data":"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc"} Jul 17 10:09:15.918714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.918530 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jtvk2" event={"ID":"f76c17c0-b6c6-42e0-b02f-940718a74be5","Type":"ContainerDied","Data":"ee6889b6163fb5f85626e62304352d3c60ae16be95f398afc456ec262e76aff9"} Jul 17 10:09:15.918714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.918552 2562 scope.go:117] "RemoveContainer" containerID="a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc" Jul 17 10:09:15.927303 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.927286 2562 scope.go:117] "RemoveContainer" containerID="a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc" Jul 17 10:09:15.927587 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:09:15.927569 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc\": container with ID starting with a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc not found: ID does not exist" containerID="a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc" Jul 17 10:09:15.927627 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.927597 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc"} err="failed to get container status \"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc\": rpc error: code = NotFound desc = could not find container \"a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc\": container with ID starting with a1fee1d849e82df83aef548942d636a98518d1b6a66706cffdc4f15f562503bc not found: ID does not exist" Jul 17 10:09:15.961797 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.961760 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:15.967176 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:15.967149 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jtvk2"] Jul 17 10:09:16.545895 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:16.545862 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f76c17c0-b6c6-42e0-b02f-940718a74be5" path="/var/lib/kubelet/pods/f76c17c0-b6c6-42e0-b02f-940718a74be5/volumes" Jul 17 10:09:16.716661 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:16.716628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:16.818583 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:16.818498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:23.909175 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:23.909143 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:24.224223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.224135 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:24.224371 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.224324 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" podUID="57e990e1-ce81-4f39-b0ff-cd3c91874950" containerName="limitador" containerID="cri-o://4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4" gracePeriod=30 Jul 17 10:09:24.787358 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.787294 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:24.863830 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.863793 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file\") pod \"57e990e1-ce81-4f39-b0ff-cd3c91874950\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " Jul 17 10:09:24.864007 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.863845 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8q85g\" (UniqueName: \"kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g\") pod \"57e990e1-ce81-4f39-b0ff-cd3c91874950\" (UID: \"57e990e1-ce81-4f39-b0ff-cd3c91874950\") " Jul 17 10:09:24.864201 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.864174 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file" (OuterVolumeSpecName: "config-file") pod "57e990e1-ce81-4f39-b0ff-cd3c91874950" (UID: "57e990e1-ce81-4f39-b0ff-cd3c91874950"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 10:09:24.865996 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.865970 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g" (OuterVolumeSpecName: "kube-api-access-8q85g") pod "57e990e1-ce81-4f39-b0ff-cd3c91874950" (UID: "57e990e1-ce81-4f39-b0ff-cd3c91874950"). InnerVolumeSpecName "kube-api-access-8q85g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:09:24.962471 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.962438 2562 generic.go:356] "Generic (PLEG): container finished" podID="57e990e1-ce81-4f39-b0ff-cd3c91874950" containerID="4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4" exitCode=0 Jul 17 10:09:24.962847 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.962486 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" Jul 17 10:09:24.962847 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.962522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" event={"ID":"57e990e1-ce81-4f39-b0ff-cd3c91874950","Type":"ContainerDied","Data":"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4"} Jul 17 10:09:24.962847 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.962574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-v7qll" event={"ID":"57e990e1-ce81-4f39-b0ff-cd3c91874950","Type":"ContainerDied","Data":"fcbe0eb71ca816253fc50a053ddd69ca726d396424a7aa1f91215b22e522740f"} Jul 17 10:09:24.962847 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.962598 2562 scope.go:117] "RemoveContainer" containerID="4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4" Jul 17 10:09:24.964402 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.964382 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/57e990e1-ce81-4f39-b0ff-cd3c91874950-config-file\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:09:24.964402 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.964401 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q85g\" (UniqueName: \"kubernetes.io/projected/57e990e1-ce81-4f39-b0ff-cd3c91874950-kube-api-access-8q85g\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:09:24.971636 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.971619 2562 scope.go:117] "RemoveContainer" containerID="4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4" Jul 17 10:09:24.971886 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:09:24.971869 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4\": container with ID starting with 4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4 not found: ID does not exist" containerID="4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4" Jul 17 10:09:24.972028 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.971919 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4"} err="failed to get container status \"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4\": rpc error: code = NotFound desc = could not find container \"4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4\": container with ID starting with 4fc690df27d32c8661f430c5cad0af4e4208385cbd405873ad8572342dd2cfd4 not found: ID does not exist" Jul 17 10:09:24.989972 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.989941 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:24.997116 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:24.997090 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-v7qll"] Jul 17 10:09:26.546807 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:26.546767 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57e990e1-ce81-4f39-b0ff-cd3c91874950" path="/var/lib/kubelet/pods/57e990e1-ce81-4f39-b0ff-cd3c91874950/volumes" Jul 17 10:09:28.402374 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.402337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:28.510249 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.510191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:28.872079 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872047 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k"] Jul 17 10:09:28.872431 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872417 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f76c17c0-b6c6-42e0-b02f-940718a74be5" containerName="authorino" Jul 17 10:09:28.872478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872433 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f76c17c0-b6c6-42e0-b02f-940718a74be5" containerName="authorino" Jul 17 10:09:28.872478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872453 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57e990e1-ce81-4f39-b0ff-cd3c91874950" containerName="limitador" Jul 17 10:09:28.872478 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872459 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57e990e1-ce81-4f39-b0ff-cd3c91874950" containerName="limitador" Jul 17 10:09:28.872567 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872516 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f76c17c0-b6c6-42e0-b02f-940718a74be5" containerName="authorino" Jul 17 10:09:28.872567 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.872529 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57e990e1-ce81-4f39-b0ff-cd3c91874950" containerName="limitador" Jul 17 10:09:28.877037 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.877014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:28.881554 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.881532 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 17 10:09:28.881781 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.881764 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 17 10:09:28.881931 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.881882 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 17 10:09:28.882635 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.882615 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qvpfl\"" Jul 17 10:09:28.889131 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.889107 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k"] Jul 17 10:09:28.898152 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.898127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-data\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:28.898261 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.898171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46z5k\" (UniqueName: \"kubernetes.io/projected/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-kube-api-access-46z5k\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:28.914741 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.914705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:28.998588 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.998558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-data\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:28.998756 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.998602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46z5k\" (UniqueName: \"kubernetes.io/projected/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-kube-api-access-46z5k\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:28.999050 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:28.999030 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-data\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:29.007293 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:29.007266 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46z5k\" (UniqueName: \"kubernetes.io/projected/ef7ffc2c-a097-47b3-9a05-e963e28c3f6e-kube-api-access-46z5k\") pod \"postgres-69fb4594cf-fdp5k\" (UID: \"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:29.186968 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:29.186879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:29.332013 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:29.331841 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k"] Jul 17 10:09:29.334804 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:09:29.334778 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7ffc2c_a097_47b3_9a05_e963e28c3f6e.slice/crio-e03acd3f2388d2788da7428808683bcd03f402e5de8ed0e809a074d606be27e0 WatchSource:0}: Error finding container e03acd3f2388d2788da7428808683bcd03f402e5de8ed0e809a074d606be27e0: Status 404 returned error can't find the container with id e03acd3f2388d2788da7428808683bcd03f402e5de8ed0e809a074d606be27e0 Jul 17 10:09:29.987203 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:29.987168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" event={"ID":"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e","Type":"ContainerStarted","Data":"e03acd3f2388d2788da7428808683bcd03f402e5de8ed0e809a074d606be27e0"} Jul 17 10:09:35.015962 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:35.015892 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" event={"ID":"ef7ffc2c-a097-47b3-9a05-e963e28c3f6e","Type":"ContainerStarted","Data":"8743fc1bee90ded4a9f2c168bd102c49df9d8b77b728eacd2936e1abca0ce17f"} Jul 17 10:09:35.016386 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:35.015977 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:35.036544 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:35.036492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" podStartSLOduration=2.251787576 podStartE2EDuration="7.036476222s" totalImagesPullingTime="4.784688646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:35.03546658 +0000 UTC m=+532.180043151" watchObservedRunningTime="2026-07-17 10:09:35.036476222 +0000 UTC m=+532.181052792" Jul 17 10:09:41.051124 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.051095 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fdp5k" Jul 17 10:09:41.435111 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.435022 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:41.581613 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.581576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:41.616343 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.616307 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:41.622387 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.622360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:41.624963 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.624941 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hrxvz\"" Jul 17 10:09:41.628612 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.628577 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:41.713551 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.713464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz74z\" (UniqueName: \"kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z\") pod \"authorino-5d4b67c446-f8pd4\" (UID: \"b370c38d-3456-41f8-bc82-8587000a4724\") " pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:41.814223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.814182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz74z\" (UniqueName: \"kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z\") pod \"authorino-5d4b67c446-f8pd4\" (UID: \"b370c38d-3456-41f8-bc82-8587000a4724\") " pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:41.829582 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.829554 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz74z\" (UniqueName: \"kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z\") pod \"authorino-5d4b67c446-f8pd4\" (UID: \"b370c38d-3456-41f8-bc82-8587000a4724\") " pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:41.896973 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.896919 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:41.897247 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.897229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:41.930760 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.930727 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:09:41.935201 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.935172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:41.938497 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.938469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 17 10:09:41.945934 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:41.945886 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:09:42.016378 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.016341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.016543 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.016475 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drr58\" (UniqueName: \"kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.043588 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.043560 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:42.046420 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:09:42.046386 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb370c38d_3456_41f8_bc82_8587000a4724.slice/crio-10e8eb8cd37b885fc5391185cf70e822c6851b97917b48f5a5b473955ae74386 WatchSource:0}: Error finding container 10e8eb8cd37b885fc5391185cf70e822c6851b97917b48f5a5b473955ae74386: Status 404 returned error can't find the container with id 10e8eb8cd37b885fc5391185cf70e822c6851b97917b48f5a5b473955ae74386 Jul 17 10:09:42.117367 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.117327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.117735 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.117405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drr58\" (UniqueName: \"kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.119756 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.119736 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.132459 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.132437 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drr58\" (UniqueName: \"kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58\") pod \"authorino-68b5c57db7-zb89z\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.246858 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.246766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:09:42.397750 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:42.397722 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:09:42.400272 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:09:42.400248 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda45695ed_51db_448d_8f93_fb79baaf8120.slice/crio-94f43007493ded5fa03c5d077f881d899b9a5333e7997e1183708d84c2a8af99 WatchSource:0}: Error finding container 94f43007493ded5fa03c5d077f881d899b9a5333e7997e1183708d84c2a8af99: Status 404 returned error can't find the container with id 94f43007493ded5fa03c5d077f881d899b9a5333e7997e1183708d84c2a8af99 Jul 17 10:09:43.056855 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.056813 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b5c57db7-zb89z" event={"ID":"a45695ed-51db-448d-8f93-fb79baaf8120","Type":"ContainerStarted","Data":"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693"} Jul 17 10:09:43.057227 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.056864 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b5c57db7-zb89z" event={"ID":"a45695ed-51db-448d-8f93-fb79baaf8120","Type":"ContainerStarted","Data":"94f43007493ded5fa03c5d077f881d899b9a5333e7997e1183708d84c2a8af99"} Jul 17 10:09:43.058357 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.058333 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" event={"ID":"b370c38d-3456-41f8-bc82-8587000a4724","Type":"ContainerStarted","Data":"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3"} Jul 17 10:09:43.058487 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.058365 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" event={"ID":"b370c38d-3456-41f8-bc82-8587000a4724","Type":"ContainerStarted","Data":"10e8eb8cd37b885fc5391185cf70e822c6851b97917b48f5a5b473955ae74386"} Jul 17 10:09:43.058487 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.058415 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" podUID="b370c38d-3456-41f8-bc82-8587000a4724" containerName="authorino" containerID="cri-o://a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3" gracePeriod=30 Jul 17 10:09:43.075673 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.075619 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68b5c57db7-zb89z" podStartSLOduration=1.644022874 podStartE2EDuration="2.075603182s" totalImagesPullingTime="431.580308ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:43.073395419 +0000 UTC m=+540.217971991" watchObservedRunningTime="2026-07-17 10:09:43.075603182 +0000 UTC m=+540.220179828" Jul 17 10:09:43.091081 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.090979 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" podStartSLOduration=1.5594018859999998 podStartE2EDuration="2.090960532s" totalImagesPullingTime="531.558646ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:09:43.089106439 +0000 UTC m=+540.233683010" watchObservedRunningTime="2026-07-17 10:09:43.090960532 +0000 UTC m=+540.235537102" Jul 17 10:09:43.305289 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.305262 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:43.428833 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.428732 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz74z\" (UniqueName: \"kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z\") pod \"b370c38d-3456-41f8-bc82-8587000a4724\" (UID: \"b370c38d-3456-41f8-bc82-8587000a4724\") " Jul 17 10:09:43.430980 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.430947 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z" (OuterVolumeSpecName: "kube-api-access-qz74z") pod "b370c38d-3456-41f8-bc82-8587000a4724" (UID: "b370c38d-3456-41f8-bc82-8587000a4724"). InnerVolumeSpecName "kube-api-access-qz74z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:09:43.529587 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:43.529550 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz74z\" (UniqueName: \"kubernetes.io/projected/b370c38d-3456-41f8-bc82-8587000a4724-kube-api-access-qz74z\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:09:44.064815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.064777 2562 generic.go:356] "Generic (PLEG): container finished" podID="b370c38d-3456-41f8-bc82-8587000a4724" containerID="a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3" exitCode=0 Jul 17 10:09:44.065034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.064836 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" Jul 17 10:09:44.065034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.064860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" event={"ID":"b370c38d-3456-41f8-bc82-8587000a4724","Type":"ContainerDied","Data":"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3"} Jul 17 10:09:44.065034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.064915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f8pd4" event={"ID":"b370c38d-3456-41f8-bc82-8587000a4724","Type":"ContainerDied","Data":"10e8eb8cd37b885fc5391185cf70e822c6851b97917b48f5a5b473955ae74386"} Jul 17 10:09:44.065034 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.064934 2562 scope.go:117] "RemoveContainer" containerID="a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3" Jul 17 10:09:44.074082 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.074064 2562 scope.go:117] "RemoveContainer" containerID="a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3" Jul 17 10:09:44.074318 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:09:44.074303 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3\": container with ID starting with a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3 not found: ID does not exist" containerID="a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3" Jul 17 10:09:44.074357 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.074327 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3"} err="failed to get container status \"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3\": rpc error: code = NotFound desc = could not find container \"a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3\": container with ID starting with a10e7980be611ca4771db12c109053eea2dd6c0e0c611a42c3dc33bca64ecbe3 not found: ID does not exist" Jul 17 10:09:44.086828 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.086765 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:44.090344 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.090320 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f8pd4"] Jul 17 10:09:44.547110 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:44.547072 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b370c38d-3456-41f8-bc82-8587000a4724" path="/var/lib/kubelet/pods/b370c38d-3456-41f8-bc82-8587000a4724/volumes" Jul 17 10:09:47.989133 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:47.989091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:48.189345 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:48.189298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:48.297095 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:48.297057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:48.600439 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:48.600335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:51.354350 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:51.354305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:09:51.451414 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:09:51.451382 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:24.090949 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:24.090896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:24.188299 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:24.188260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:24.663799 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:24.663744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:25.137744 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.137704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:25.288933 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.288875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:25.387336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.387300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:25.427585 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.427499 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-xl472"] Jul 17 10:10:25.427892 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.427880 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b370c38d-3456-41f8-bc82-8587000a4724" containerName="authorino" Jul 17 10:10:25.427972 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.427894 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b370c38d-3456-41f8-bc82-8587000a4724" containerName="authorino" Jul 17 10:10:25.428013 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.427984 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b370c38d-3456-41f8-bc82-8587000a4724" containerName="authorino" Jul 17 10:10:25.431086 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.431067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.433913 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.433879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sbdgp\"" Jul 17 10:10:25.434442 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.434428 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 17 10:10:25.441299 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.441272 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-xl472"] Jul 17 10:10:25.481981 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.481945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqhq4\" (UniqueName: \"kubernetes.io/projected/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-kube-api-access-dqhq4\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.482147 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.481996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.583448 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.583411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqhq4\" (UniqueName: \"kubernetes.io/projected/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-kube-api-access-dqhq4\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.583641 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.583459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.584165 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.584145 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-plugins-config-volume\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.592438 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.592411 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqhq4\" (UniqueName: \"kubernetes.io/projected/e3572db9-914a-4df6-baa6-8d2bf0e7cd4e-kube-api-access-dqhq4\") pod \"payload-processing-5bf47cd988-xl472\" (UID: \"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e\") " pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.742372 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.742272 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:25.916912 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:25.916878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-xl472"] Jul 17 10:10:25.919253 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:10:25.919221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3572db9_914a_4df6_baa6_8d2bf0e7cd4e.slice/crio-8d2f342e3e441d47fdbcd9506c65751b2232eb4e48618f0c4aa682d56290a4f5 WatchSource:0}: Error finding container 8d2f342e3e441d47fdbcd9506c65751b2232eb4e48618f0c4aa682d56290a4f5: Status 404 returned error can't find the container with id 8d2f342e3e441d47fdbcd9506c65751b2232eb4e48618f0c4aa682d56290a4f5 Jul 17 10:10:26.276414 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:26.276376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" event={"ID":"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e","Type":"ContainerStarted","Data":"8d2f342e3e441d47fdbcd9506c65751b2232eb4e48618f0c4aa682d56290a4f5"} Jul 17 10:10:28.289480 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:28.289445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" event={"ID":"e3572db9-914a-4df6-baa6-8d2bf0e7cd4e","Type":"ContainerStarted","Data":"df902e21bd181fc6eca37b9d47b0e72a01c07a4a333c936897f05d06e0b86028"} Jul 17 10:10:28.289923 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:28.289578 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:28.314529 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:28.314473 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" podStartSLOduration=1.258534918 podStartE2EDuration="3.314456545s" totalImagesPullingTime="2.055921627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:10:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:10:28.31338893 +0000 UTC m=+585.457965501" watchObservedRunningTime="2026-07-17 10:10:28.314456545 +0000 UTC m=+585.459033114" Jul 17 10:10:34.110745 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:34.110706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:34.210881 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:34.210842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:35.528629 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:35.528592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:35.627586 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:35.627530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:39.296058 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:39.296027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-xl472" Jul 17 10:10:43.028341 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:43.028302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:44.396864 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:44.396828 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:10:44.398073 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:44.398051 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:10:51.835416 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.835381 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4422c"] Jul 17 10:10:51.839114 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.839092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.843294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.843273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 17 10:10:51.843294 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.843289 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 10:10:51.843610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.843593 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 10:10:51.843692 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.843608 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rvc27\"" Jul 17 10:10:51.851948 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.851926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4422c"] Jul 17 10:10:51.883708 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.883674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:51.919605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jrtb\" (UniqueName: \"kubernetes.io/projected/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-kube-api-access-4jrtb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.919605 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.919820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.919820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.919820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:51.919820 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:51.919806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.020883 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.020842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jrtb\" (UniqueName: \"kubernetes.io/projected/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-kube-api-access-4jrtb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.020883 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.020886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021152 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.020953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021152 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.020980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021152 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.021122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021299 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.021173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021473 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.021443 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021601 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.021513 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.021601 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.021563 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.023212 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.023192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.023487 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.023467 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.030840 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.030815 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jrtb\" (UniqueName: \"kubernetes.io/projected/13a3970f-9fcd-4900-a1d9-4e4d7a76022d-kube-api-access-4jrtb\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4422c\" (UID: \"13a3970f-9fcd-4900-a1d9-4e4d7a76022d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.153248 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.153145 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:10:52.296425 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.296398 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4422c"] Jul 17 10:10:52.298987 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:10:52.298959 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13a3970f_9fcd_4900_a1d9_4e4d7a76022d.slice/crio-c35cb1297389613d8505e5bb13b665aca87dbdbbf8eebc54142d3c2db49337fd WatchSource:0}: Error finding container c35cb1297389613d8505e5bb13b665aca87dbdbbf8eebc54142d3c2db49337fd: Status 404 returned error can't find the container with id c35cb1297389613d8505e5bb13b665aca87dbdbbf8eebc54142d3c2db49337fd Jul 17 10:10:52.408514 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:52.408432 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" event={"ID":"13a3970f-9fcd-4900-a1d9-4e4d7a76022d","Type":"ContainerStarted","Data":"c35cb1297389613d8505e5bb13b665aca87dbdbbf8eebc54142d3c2db49337fd"} Jul 17 10:10:54.421982 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:54.421939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" event={"ID":"13a3970f-9fcd-4900-a1d9-4e4d7a76022d","Type":"ContainerStarted","Data":"059008c4eb373fbe1b7f36ad4871b6a6590de808ee5c778c27d1ff3e15c8b380"} Jul 17 10:10:54.450267 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:54.450208 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" podStartSLOduration=2.2019109119999998 podStartE2EDuration="3.450185867s" totalImagesPullingTime="1.248274955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:10:54.448882443 +0000 UTC m=+611.593459012" watchObservedRunningTime="2026-07-17 10:10:54.450185867 +0000 UTC m=+611.594762438" Jul 17 10:10:58.735383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.735349 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2"] Jul 17 10:10:58.740309 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.740276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.744839 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.744811 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 10:10:58.751249 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.751224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2"] Jul 17 10:10:58.772547 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.772517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:10:58.885660 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.885660 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.885938 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.885938 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.885938 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxl29\" (UniqueName: \"kubernetes.io/projected/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-kube-api-access-bxl29\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.885938 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.885833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987217 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxl29\" (UniqueName: \"kubernetes.io/projected/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-kube-api-access-bxl29\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987383 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987655 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987715 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987673 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.987764 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.987705 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.989529 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.989505 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.989764 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.989748 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:58.996350 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:58.996329 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxl29\" (UniqueName: \"kubernetes.io/projected/1816aafa-c5cf-4b5a-92fd-d6b980a02cf5-kube-api-access-bxl29\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2p2m2\" (UID: \"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:59.053256 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:59.053218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:10:59.191795 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:59.191764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2"] Jul 17 10:10:59.193712 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:10:59.193685 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1816aafa_c5cf_4b5a_92fd_d6b980a02cf5.slice/crio-76ccd970fcc2b661ef5ca1f223cc14bd9d70bd35cda024a26fec43a70b06ce96 WatchSource:0}: Error finding container 76ccd970fcc2b661ef5ca1f223cc14bd9d70bd35cda024a26fec43a70b06ce96: Status 404 returned error can't find the container with id 76ccd970fcc2b661ef5ca1f223cc14bd9d70bd35cda024a26fec43a70b06ce96 Jul 17 10:10:59.449349 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:10:59.449315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" event={"ID":"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5","Type":"ContainerStarted","Data":"76ccd970fcc2b661ef5ca1f223cc14bd9d70bd35cda024a26fec43a70b06ce96"} Jul 17 10:11:00.456336 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:00.456303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" event={"ID":"1816aafa-c5cf-4b5a-92fd-d6b980a02cf5","Type":"ContainerStarted","Data":"fa669488ef9e905de8faede73252fcf9f097a6d9b983dbad4b9c854fe72598a3"} Jul 17 10:11:00.489399 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:00.489340 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" podStartSLOduration=2.283712602 podStartE2EDuration="2.489321273s" totalImagesPullingTime="205.608671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:10:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:11:00.487734541 +0000 UTC m=+617.632311102" watchObservedRunningTime="2026-07-17 10:11:00.489321273 +0000 UTC m=+617.633897842" Jul 17 10:11:02.154044 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:02.154011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:11:02.154515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:02.154077 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:11:02.166999 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:02.166965 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:11:02.477952 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:02.477854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4422c" Jul 17 10:11:06.953930 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:06.953840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:11:09.053406 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:09.053352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:11:09.053787 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:09.053445 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:11:09.066092 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:09.066050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:11:09.510986 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:09.510957 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2p2m2" Jul 17 10:11:24.746049 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:24.746008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:11:47.888328 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:47.888293 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:11:51.198824 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:11:51.198782 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:26.309843 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:26.309797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:26.423834 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:26.423799 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:53.412398 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:53.412354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:53.512918 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:53.512864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:54.662127 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:54.662063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:54.745745 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:54.745701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:12:55.203266 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.203214 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:12:55.203480 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.203424 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-68b5c57db7-zb89z" podUID="a45695ed-51db-448d-8f93-fb79baaf8120" containerName="authorino" containerID="cri-o://74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693" gracePeriod=30 Jul 17 10:12:55.469671 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.469641 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:12:55.618321 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.618288 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drr58\" (UniqueName: \"kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58\") pod \"a45695ed-51db-448d-8f93-fb79baaf8120\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " Jul 17 10:12:55.618498 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.618398 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert\") pod \"a45695ed-51db-448d-8f93-fb79baaf8120\" (UID: \"a45695ed-51db-448d-8f93-fb79baaf8120\") " Jul 17 10:12:55.620378 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.620343 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58" (OuterVolumeSpecName: "kube-api-access-drr58") pod "a45695ed-51db-448d-8f93-fb79baaf8120" (UID: "a45695ed-51db-448d-8f93-fb79baaf8120"). InnerVolumeSpecName "kube-api-access-drr58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 10:12:55.629560 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.629527 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a45695ed-51db-448d-8f93-fb79baaf8120" (UID: "a45695ed-51db-448d-8f93-fb79baaf8120"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 10:12:55.719333 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.719234 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drr58\" (UniqueName: \"kubernetes.io/projected/a45695ed-51db-448d-8f93-fb79baaf8120-kube-api-access-drr58\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:12:55.719333 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:55.719277 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a45695ed-51db-448d-8f93-fb79baaf8120-tls-cert\") on node \"ip-10-0-128-133.ec2.internal\" DevicePath \"\"" Jul 17 10:12:56.027621 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.027587 2562 generic.go:356] "Generic (PLEG): container finished" podID="a45695ed-51db-448d-8f93-fb79baaf8120" containerID="74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693" exitCode=0 Jul 17 10:12:56.027822 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.027642 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68b5c57db7-zb89z" Jul 17 10:12:56.027822 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.027666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b5c57db7-zb89z" event={"ID":"a45695ed-51db-448d-8f93-fb79baaf8120","Type":"ContainerDied","Data":"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693"} Jul 17 10:12:56.027822 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.027712 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68b5c57db7-zb89z" event={"ID":"a45695ed-51db-448d-8f93-fb79baaf8120","Type":"ContainerDied","Data":"94f43007493ded5fa03c5d077f881d899b9a5333e7997e1183708d84c2a8af99"} Jul 17 10:12:56.027822 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.027730 2562 scope.go:117] "RemoveContainer" containerID="74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693" Jul 17 10:12:56.038164 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.038136 2562 scope.go:117] "RemoveContainer" containerID="74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693" Jul 17 10:12:56.038428 ip-10-0-128-133 kubenswrapper[2562]: E0717 10:12:56.038410 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693\": container with ID starting with 74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693 not found: ID does not exist" containerID="74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693" Jul 17 10:12:56.038496 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.038436 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693"} err="failed to get container status \"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693\": rpc error: code = NotFound desc = could not find container \"74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693\": container with ID starting with 74befda7c6c05177e6d10afeae01113055c80d44f4e8a589b0e4a853696fc693 not found: ID does not exist" Jul 17 10:12:56.052699 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.052658 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:12:56.062662 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.062626 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68b5c57db7-zb89z"] Jul 17 10:12:56.546973 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:12:56.546938 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a45695ed-51db-448d-8f93-fb79baaf8120" path="/var/lib/kubelet/pods/a45695ed-51db-448d-8f93-fb79baaf8120/volumes" Jul 17 10:13:04.706349 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:04.706304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:13:39.475315 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:39.475285 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-phz9m_450a9242-3ded-4464-9fc2-bad31a10d694/manager/0.log" Jul 17 10:13:39.858306 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:39.858278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7fwqm_b1084cf9-fade-403c-88e6-2d9d9e47ad22/server/0.log" Jul 17 10:13:39.979770 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:39.979734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n94z8_0404b0e1-4dff-4a12-aa28-86adddd6a946/manager/0.log" Jul 17 10:13:40.223515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:40.223434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79948f9745-xxhsg_7afba983-36a1-4711-9007-893c20c0e810/copy-manifests/0.log" Jul 17 10:13:40.244387 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:40.244352 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79948f9745-xxhsg_7afba983-36a1-4711-9007-893c20c0e810/manager/0.log" Jul 17 10:13:40.828193 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:40.828156 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-fdp5k_ef7ffc2c-a097-47b3-9a05-e963e28c3f6e/postgres/0.log" Jul 17 10:13:42.240007 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:42.239978 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mfbjx_41aea090-5229-46c0-b478-d0f93d83113e/manager/0.log" Jul 17 10:13:42.360733 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:42.360703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jz9x4_0cca839e-6ea5-4faf-8292-5759a8dd2ca4/manager/0.log" Jul 17 10:13:42.584479 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:42.584450 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mcxhg_ea550eb5-57ce-4832-88c5-e63f0e564617/registry-server/0.log" Jul 17 10:13:42.719291 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:42.719261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfmsz_5644ec3c-c2cb-4337-a053-8e2f3b2f0be2/manager/0.log" Jul 17 10:13:42.999155 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:42.999124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nt7sb_7fafad9b-edbb-41ab-9b28-249525a7d409/manager/0.log" Jul 17 10:13:43.586856 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:43.586818 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bb8bccf4-772fj_02901b9b-68d5-4e6f-bb0d-a6b9ed950c03/kube-auth-proxy/0.log" Jul 17 10:13:44.044827 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:44.044794 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-xl472_e3572db9-914a-4df6-baa6-8d2bf0e7cd4e/payload-processing/0.log" Jul 17 10:13:44.158360 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:44.158326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696d6cd74-glp2h_2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5/router/0.log" Jul 17 10:13:44.611488 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:44.611459 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4422c_13a3970f-9fcd-4900-a1d9-4e4d7a76022d/main/0.log" Jul 17 10:13:44.726616 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:44.726531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2p2m2_1816aafa-c5cf-4b5a-92fd-d6b980a02cf5/main/0.log" Jul 17 10:13:51.103409 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.103373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:13:51.103889 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.103865 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6m77k/must-gather-gn4xx"] Jul 17 10:13:51.104377 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.104360 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a45695ed-51db-448d-8f93-fb79baaf8120" containerName="authorino" Jul 17 10:13:51.104427 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.104379 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a45695ed-51db-448d-8f93-fb79baaf8120" containerName="authorino" Jul 17 10:13:51.104466 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.104452 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a45695ed-51db-448d-8f93-fb79baaf8120" containerName="authorino" Jul 17 10:13:51.108739 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.108723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.119216 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.119192 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6m77k\"/\"kube-root-ca.crt\"" Jul 17 10:13:51.124862 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.124843 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6m77k\"/\"openshift-service-ca.crt\"" Jul 17 10:13:51.156302 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.156262 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6m77k/must-gather-gn4xx"] Jul 17 10:13:51.237387 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.237344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" limit=1024 Jul 17 10:13:51.293577 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.293537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-must-gather-output\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.293763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.293606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vxh\" (UniqueName: \"kubernetes.io/projected/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-kube-api-access-44vxh\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.394879 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.394784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-must-gather-output\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.395081 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.394935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vxh\" (UniqueName: \"kubernetes.io/projected/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-kube-api-access-44vxh\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.395210 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.395143 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-must-gather-output\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.415134 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.415099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vxh\" (UniqueName: \"kubernetes.io/projected/47fd5cca-0bac-45bc-8575-ce0dbdcb1841-kube-api-access-44vxh\") pod \"must-gather-gn4xx\" (UID: \"47fd5cca-0bac-45bc-8575-ce0dbdcb1841\") " pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.417981 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.417955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6m77k/must-gather-gn4xx" Jul 17 10:13:51.575238 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.575055 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6m77k/must-gather-gn4xx"] Jul 17 10:13:51.577753 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:13:51.577725 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47fd5cca_0bac_45bc_8575_ce0dbdcb1841.slice/crio-c9f2008f7c55e58c01fccb8dece25bed22257e3d129e6503491d31e3a3cdae39 WatchSource:0}: Error finding container c9f2008f7c55e58c01fccb8dece25bed22257e3d129e6503491d31e3a3cdae39: Status 404 returned error can't find the container with id c9f2008f7c55e58c01fccb8dece25bed22257e3d129e6503491d31e3a3cdae39 Jul 17 10:13:51.579854 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:51.579838 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 10:13:52.313311 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:52.313272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6m77k/must-gather-gn4xx" event={"ID":"47fd5cca-0bac-45bc-8575-ce0dbdcb1841","Type":"ContainerStarted","Data":"c9f2008f7c55e58c01fccb8dece25bed22257e3d129e6503491d31e3a3cdae39"} Jul 17 10:13:53.323286 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:53.323238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6m77k/must-gather-gn4xx" event={"ID":"47fd5cca-0bac-45bc-8575-ce0dbdcb1841","Type":"ContainerStarted","Data":"7741a9cf3892bd3eebdf3942b5ae470f2cdf3f9b6a668e495452b22288c28b61"} Jul 17 10:13:53.323714 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:53.323297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6m77k/must-gather-gn4xx" event={"ID":"47fd5cca-0bac-45bc-8575-ce0dbdcb1841","Type":"ContainerStarted","Data":"beb4c9b4a4fb4e795fd5d3fef3ad49d364b94dbbe64ab013eb3d3a1b0cff42e1"} Jul 17 10:13:53.355878 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:53.355818 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6m77k/must-gather-gn4xx" podStartSLOduration=1.554829755 podStartE2EDuration="2.355799892s" totalImagesPullingTime="800.970137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 10:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:13:53.353313717 +0000 UTC m=+790.497890288" watchObservedRunningTime="2026-07-17 10:13:53.355799892 +0000 UTC m=+790.500376463" Jul 17 10:13:54.384954 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:54.384920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-klfz9_7f036d05-90c6-482a-9ce5-93576c140616/global-pull-secret-syncer/0.log" Jul 17 10:13:54.464065 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:54.464033 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9lvv_6ee4dce7-74a1-4fa0-98ee-1a502c4e1bc2/konnectivity-agent/0.log" Jul 17 10:13:54.553967 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:54.553937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-133.ec2.internal_d49fefa60dd8a770e103ab3be5b48825/haproxy/0.log" Jul 17 10:13:59.894645 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:59.894604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mfbjx_41aea090-5229-46c0-b478-d0f93d83113e/manager/0.log" Jul 17 10:13:59.940918 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:13:59.940870 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jz9x4_0cca839e-6ea5-4faf-8292-5759a8dd2ca4/manager/0.log" Jul 17 10:14:00.032153 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:00.032111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mcxhg_ea550eb5-57ce-4832-88c5-e63f0e564617/registry-server/0.log" Jul 17 10:14:00.134702 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:00.134658 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-rfmsz_5644ec3c-c2cb-4337-a053-8e2f3b2f0be2/manager/0.log" Jul 17 10:14:00.208390 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:00.208300 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nt7sb_7fafad9b-edbb-41ab-9b28-249525a7d409/manager/0.log" Jul 17 10:14:02.260108 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:02.259986 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-sf2v5_2c6b65b3-a081-49bc-8f6b-ba46bff55fba/cluster-monitoring-operator/0.log" Jul 17 10:14:02.627459 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:02.627354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2s586_524dccbc-d633-4df5-8c0e-92b367d4f854/node-exporter/0.log" Jul 17 10:14:02.677249 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:02.677196 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2s586_524dccbc-d633-4df5-8c0e-92b367d4f854/kube-rbac-proxy/0.log" Jul 17 10:14:02.715027 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:02.714996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2s586_524dccbc-d633-4df5-8c0e-92b367d4f854/init-textfile/0.log" Jul 17 10:14:03.897481 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.897440 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg"] Jul 17 10:14:03.903548 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.903519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:03.907886 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.907857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6m77k\"/\"default-dockercfg-7ptbn\"" Jul 17 10:14:03.911435 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.911405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg"] Jul 17 10:14:03.932279 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.932233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-sys\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:03.932279 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.932283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-proc\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:03.932526 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.932317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zkzq\" (UniqueName: \"kubernetes.io/projected/2c0af88c-b05d-4a66-803b-24efef56c7da-kube-api-access-4zkzq\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:03.932526 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.932369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-podres\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:03.932526 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:03.932448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-lib-modules\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033349 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-lib-modules\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033542 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-sys\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033542 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-proc\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033542 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zkzq\" (UniqueName: \"kubernetes.io/projected/2c0af88c-b05d-4a66-803b-24efef56c7da-kube-api-access-4zkzq\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033542 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-podres\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033542 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033500 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-sys\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033829 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033547 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-proc\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033829 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033609 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-podres\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.033957 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.033844 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c0af88c-b05d-4a66-803b-24efef56c7da-lib-modules\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.048804 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.048766 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zkzq\" (UniqueName: \"kubernetes.io/projected/2c0af88c-b05d-4a66-803b-24efef56c7da-kube-api-access-4zkzq\") pod \"perf-node-gather-daemonset-dtwfg\" (UID: \"2c0af88c-b05d-4a66-803b-24efef56c7da\") " pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.216078 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.215983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:04.384951 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.384921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg"] Jul 17 10:14:04.387856 ip-10-0-128-133 kubenswrapper[2562]: W0717 10:14:04.387824 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2c0af88c_b05d_4a66_803b_24efef56c7da.slice/crio-5587bc6f2fd45e5e00e8c657e1d16135e9f6c2965ffdcaa92b0108c557a30198 WatchSource:0}: Error finding container 5587bc6f2fd45e5e00e8c657e1d16135e9f6c2965ffdcaa92b0108c557a30198: Status 404 returned error can't find the container with id 5587bc6f2fd45e5e00e8c657e1d16135e9f6c2965ffdcaa92b0108c557a30198 Jul 17 10:14:04.417223 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:04.417182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" event={"ID":"2c0af88c-b05d-4a66-803b-24efef56c7da","Type":"ContainerStarted","Data":"5587bc6f2fd45e5e00e8c657e1d16135e9f6c2965ffdcaa92b0108c557a30198"} Jul 17 10:14:05.103796 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.103756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-9bcvm_165de07f-d6cd-43d9-bb10-a1b5601ac6bd/networking-console-plugin/0.log" Jul 17 10:14:05.425815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.425692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" event={"ID":"2c0af88c-b05d-4a66-803b-24efef56c7da","Type":"ContainerStarted","Data":"bc89fe2641312c42987fc02991d1e3d954b66b7c1aa3af9250bb9e2de3ee9963"} Jul 17 10:14:05.425815 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.425751 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:05.462394 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.462334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" podStartSLOduration=2.462315642 podStartE2EDuration="2.462315642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 10:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 10:14:05.459807339 +0000 UTC m=+802.604383922" watchObservedRunningTime="2026-07-17 10:14:05.462315642 +0000 UTC m=+802.606892212" Jul 17 10:14:05.749515 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.749485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/1.log" Jul 17 10:14:05.758980 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:05.758951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-kjl8j_f070df22-8f07-4e1a-910a-8ece9bca98d3/console-operator/2.log" Jul 17 10:14:06.418928 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:06.418848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-zwbvr_cb81f3aa-c45c-4a69-bac8-8f768de18821/download-server/0.log" Jul 17 10:14:07.134763 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:07.134726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-7qpq8_01ae2933-affc-47e6-ab26-ab14dbc7e6d9/volume-data-source-validator/0.log" Jul 17 10:14:08.618868 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:08.618838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4l5d_3d53930c-d6cc-44cc-b1a9-6f2a045e7c82/dns/0.log" Jul 17 10:14:08.658649 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:08.658624 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4l5d_3d53930c-d6cc-44cc-b1a9-6f2a045e7c82/kube-rbac-proxy/0.log" Jul 17 10:14:08.813028 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:08.813001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-glgzw_23e88154-8067-47a8-a0df-c4d9d208a3d6/dns-node-resolver/0.log" Jul 17 10:14:09.542848 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:09.542813 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-slzsn_959ad77a-2636-46c5-af86-626f298fe5e3/node-ca/0.log" Jul 17 10:14:10.846986 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:10.846952 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bb8bccf4-772fj_02901b9b-68d5-4e6f-bb0d-a6b9ed950c03/kube-auth-proxy/0.log" Jul 17 10:14:10.989071 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:10.989035 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-xl472_e3572db9-914a-4df6-baa6-8d2bf0e7cd4e/payload-processing/0.log" Jul 17 10:14:11.021543 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:11.021511 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696d6cd74-glp2h_2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5/router/0.log" Jul 17 10:14:11.441879 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:11.441845 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6m77k/perf-node-gather-daemonset-dtwfg" Jul 17 10:14:11.837575 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:11.837544 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-tf8n7_7ff92ac6-9c9b-40e2-996b-e81bcd14296a/serve-healthcheck-canary/0.log" Jul 17 10:14:12.525078 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:12.525038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-ckg48_fb706e28-7cc9-4982-88d4-833d3f0f1957/insights-operator/0.log" Jul 17 10:14:12.528099 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:12.528062 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-ckg48_fb706e28-7cc9-4982-88d4-833d3f0f1957/insights-operator/1.log" Jul 17 10:14:12.810077 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:12.810045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfj2r_b9615493-04d1-48bb-adbe-926093f5d24b/kube-rbac-proxy/0.log" Jul 17 10:14:12.883499 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:12.883460 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfj2r_b9615493-04d1-48bb-adbe-926093f5d24b/exporter/0.log" Jul 17 10:14:12.958140 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:12.958109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kfj2r_b9615493-04d1-48bb-adbe-926093f5d24b/extractor/0.log" Jul 17 10:14:15.149049 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.149013 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bb8bccf4-772fj_02901b9b-68d5-4e6f-bb0d-a6b9ed950c03/kube-auth-proxy/0.log" Jul 17 10:14:15.223999 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.223969 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-xl472_e3572db9-914a-4df6-baa6-8d2bf0e7cd4e/payload-processing/0.log" Jul 17 10:14:15.252608 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.252575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696d6cd74-glp2h_2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5/router/0.log" Jul 17 10:14:15.619610 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.619579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-phz9m_450a9242-3ded-4464-9fc2-bad31a10d694/manager/0.log" Jul 17 10:14:15.733870 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.733843 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7fwqm_b1084cf9-fade-403c-88e6-2d9d9e47ad22/server/0.log" Jul 17 10:14:15.815829 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.815790 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-n94z8_0404b0e1-4dff-4a12-aa28-86adddd6a946/manager/0.log" Jul 17 10:14:15.945597 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.945513 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79948f9745-xxhsg_7afba983-36a1-4711-9007-893c20c0e810/manager/0.log" Jul 17 10:14:15.974082 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:15.974054 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79948f9745-xxhsg_7afba983-36a1-4711-9007-893c20c0e810/copy-manifests/0.log" Jul 17 10:14:16.452078 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:16.452031 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67bb8bccf4-772fj_02901b9b-68d5-4e6f-bb0d-a6b9ed950c03/kube-auth-proxy/0.log" Jul 17 10:14:16.539641 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:16.539614 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-xl472_e3572db9-914a-4df6-baa6-8d2bf0e7cd4e/payload-processing/0.log" Jul 17 10:14:16.565882 ip-10-0-128-133 kubenswrapper[2562]: I0717 10:14:16.565816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-696d6cd74-glp2h_2b88bd16-9252-4e04-ae4b-78ac2bc7cfd5/router/0.log"