Aug 05 17:12:16.214935 ip-10-0-135-121 systemd[1]: Starting Kubernetes Kubelet... Aug 05 17:12:16.661634 ip-10-0-135-121 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:16.661634 ip-10-0-135-121 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 05 17:12:16.661634 ip-10-0-135-121 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:16.661634 ip-10-0-135-121 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 05 17:12:16.661634 ip-10-0-135-121 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 05 17:12:16.662797 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.662696 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 05 17:12:16.669595 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669567 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.669595 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669591 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.669595 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669596 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.669595 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669600 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.669595 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669605 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669609 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669613 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669618 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669621 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669625 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669629 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669632 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669637 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669640 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669645 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669664 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669668 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669672 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669676 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669680 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669683 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669687 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669691 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669695 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.669931 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669699 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669702 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669706 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669710 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669715 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669718 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669722 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669726 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669730 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669734 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669738 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669743 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669749 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669752 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669757 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669761 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669765 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669768 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669773 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669777 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.670727 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669781 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669785 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669789 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669799 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669804 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669808 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669812 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669816 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669820 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669824 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669829 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669834 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669838 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669842 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669849 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669855 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669860 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669865 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669869 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669874 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.671496 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669878 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669882 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669887 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669891 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669896 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669900 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669904 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669909 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669913 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669917 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669922 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669925 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669932 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669939 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669944 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669948 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669953 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669959 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669963 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.672092 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669967 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669971 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669975 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669983 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669988 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669993 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.669997 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670003 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670007 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670012 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670017 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670022 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670026 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670031 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670035 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.672536 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.670040 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672595 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672607 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672611 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672615 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672619 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672622 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672624 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672627 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672630 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672632 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672635 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672638 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672641 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672643 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672646 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672665 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672668 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672672 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.672910 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672677 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672680 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672683 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672686 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672689 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672691 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672694 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672696 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672699 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672701 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672704 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672706 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672709 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672711 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672715 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672719 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672722 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672724 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672727 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672730 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.673368 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672732 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672735 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672737 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672740 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672742 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672745 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672748 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672751 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672753 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672756 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672759 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672762 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672764 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672767 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672769 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672772 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672774 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672777 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672780 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672783 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.673855 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672785 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672788 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672791 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672794 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672796 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672799 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672802 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672805 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672807 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672810 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672812 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672815 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672817 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672820 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672823 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672826 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672828 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672832 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672835 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672838 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.674334 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672840 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672843 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672846 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672848 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672851 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672860 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672863 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672866 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672868 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672871 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672874 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672878 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672881 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672884 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672887 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672889 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672892 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672895 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672898 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672901 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.674828 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.672904 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673349 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673355 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673358 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673361 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673364 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673367 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673371 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673375 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673378 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673381 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673384 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673386 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673390 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673394 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673397 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673400 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673403 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673405 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.675299 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673408 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673410 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673413 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673415 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673418 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673420 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673424 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673428 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673430 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673433 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673436 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673438 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673441 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673443 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673445 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673448 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673451 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673453 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673456 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.675773 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673458 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673461 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673463 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673466 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673468 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673470 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673473 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673476 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673479 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673482 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673485 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673487 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673490 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673493 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673495 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673498 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673500 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673502 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673505 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673507 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.676219 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673509 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673512 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673514 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673517 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673519 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673522 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673524 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673527 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673529 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673532 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673534 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673537 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673539 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673542 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673544 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673547 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673549 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673551 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673554 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673556 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.676749 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673559 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673563 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673578 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673582 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673584 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673588 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673591 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673593 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673596 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673599 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673602 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673604 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673607 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673609 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673612 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673614 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673617 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673620 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673622 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673625 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.677227 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673627 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.673629 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673711 2558 flags.go:64] FLAG: --address="0.0.0.0" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673719 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673726 2558 flags.go:64] FLAG: --anonymous-auth="true" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673732 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673747 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673750 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673754 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673758 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673761 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673764 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673768 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673771 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673774 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673777 2558 flags.go:64] FLAG: --cgroup-root="" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673780 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673783 2558 flags.go:64] FLAG: --client-ca-file="" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673786 2558 flags.go:64] FLAG: --cloud-provider="external" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673792 2558 flags.go:64] FLAG: --cluster-dns="[]" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673796 2558 flags.go:64] FLAG: --cluster-domain="" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673799 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673802 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673805 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 05 17:12:16.677722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673809 2558 flags.go:64] FLAG: --container-log-max-files="5" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673812 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673815 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673818 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673821 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673824 2558 flags.go:64] FLAG: --contention-profiling="false" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673827 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673830 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673833 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673836 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673839 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673842 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673845 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673848 2558 flags.go:64] FLAG: --enable-load-reader="false" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673851 2558 flags.go:64] FLAG: --enable-server="true" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673853 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673858 2558 flags.go:64] FLAG: --event-burst="100" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673861 2558 flags.go:64] FLAG: --event-qps="50" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673864 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673867 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673871 2558 flags.go:64] FLAG: --eviction-hard="" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673875 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673877 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673880 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673883 2558 flags.go:64] FLAG: --eviction-soft="" Aug 05 17:12:16.678300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673886 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673889 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673894 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673897 2558 flags.go:64] FLAG: --experimental-mounter-path="" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673899 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673902 2558 flags.go:64] FLAG: --fail-swap-on="true" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673905 2558 flags.go:64] FLAG: --feature-gates="" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673909 2558 flags.go:64] FLAG: --file-check-frequency="20s" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673912 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673915 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673918 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673921 2558 flags.go:64] FLAG: --healthz-port="10248" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673924 2558 flags.go:64] FLAG: --help="false" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673927 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673930 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673933 2558 flags.go:64] FLAG: --http-check-frequency="20s" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673936 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673939 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673942 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673945 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673948 2558 flags.go:64] FLAG: --image-service-endpoint="" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673950 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673953 2558 flags.go:64] FLAG: --kube-api-burst="100" Aug 05 17:12:16.678897 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673957 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673960 2558 flags.go:64] FLAG: --kube-api-qps="50" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673963 2558 flags.go:64] FLAG: --kube-reserved="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673966 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673969 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673972 2558 flags.go:64] FLAG: --kubelet-cgroups="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673974 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673977 2558 flags.go:64] FLAG: --lock-file="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673980 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673983 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673986 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673992 2558 flags.go:64] FLAG: --log-json-split-stream="false" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673996 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.673999 2558 flags.go:64] FLAG: --log-text-split-stream="false" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674002 2558 flags.go:64] FLAG: --logging-format="text" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674005 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674008 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674011 2558 flags.go:64] FLAG: --manifest-url="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674014 2558 flags.go:64] FLAG: --manifest-url-header="" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674018 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674021 2558 flags.go:64] FLAG: --max-open-files="1000000" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674025 2558 flags.go:64] FLAG: --max-pods="110" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674028 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674031 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674034 2558 flags.go:64] FLAG: --memory-manager-policy="None" Aug 05 17:12:16.679460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674037 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674040 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674043 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674046 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674053 2558 flags.go:64] FLAG: --node-status-max-images="50" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674056 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674059 2558 flags.go:64] FLAG: --oom-score-adj="-999" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674064 2558 flags.go:64] FLAG: --pod-cidr="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674067 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674072 2558 flags.go:64] FLAG: --pod-manifest-path="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674075 2558 flags.go:64] FLAG: --pod-max-pids="-1" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674078 2558 flags.go:64] FLAG: --pods-per-core="0" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674081 2558 flags.go:64] FLAG: --port="10250" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674084 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674087 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00ab5328cc5a4f9d1" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674090 2558 flags.go:64] FLAG: --qos-reserved="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674093 2558 flags.go:64] FLAG: --read-only-port="10255" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674096 2558 flags.go:64] FLAG: --register-node="true" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674100 2558 flags.go:64] FLAG: --register-with-taints="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674104 2558 flags.go:64] FLAG: --registry-burst="10" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674109 2558 flags.go:64] FLAG: --registry-qps="5" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674112 2558 flags.go:64] FLAG: --reserved-cpus="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674115 2558 flags.go:64] FLAG: --reserved-memory="" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674118 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674121 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 05 17:12:16.680096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674124 2558 flags.go:64] FLAG: --rotate-certificates="false" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674127 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674130 2558 flags.go:64] FLAG: --runonce="false" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674133 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674136 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674139 2558 flags.go:64] FLAG: --seccomp-default="false" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674142 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674145 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674148 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674151 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674154 2558 flags.go:64] FLAG: --storage-driver-password="root" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674156 2558 flags.go:64] FLAG: --storage-driver-secure="false" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674159 2558 flags.go:64] FLAG: --storage-driver-table="stats" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674162 2558 flags.go:64] FLAG: --storage-driver-user="root" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674165 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674169 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674172 2558 flags.go:64] FLAG: --system-cgroups="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674175 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674180 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674183 2558 flags.go:64] FLAG: --tls-cert-file="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674186 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674190 2558 flags.go:64] FLAG: --tls-min-version="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674193 2558 flags.go:64] FLAG: --tls-private-key-file="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674196 2558 flags.go:64] FLAG: --topology-manager-policy="none" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674199 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 05 17:12:16.680781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674203 2558 flags.go:64] FLAG: --topology-manager-scope="container" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674206 2558 flags.go:64] FLAG: --v="2" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674210 2558 flags.go:64] FLAG: --version="false" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674217 2558 flags.go:64] FLAG: --vmodule="" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674221 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.674224 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674361 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674366 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674369 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674372 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674375 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674377 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674380 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674383 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674385 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674387 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674390 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674393 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674395 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674398 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674400 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.681806 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674403 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674407 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674410 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674414 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674417 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674420 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674423 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674426 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674428 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674431 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674433 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674437 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674439 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674442 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674444 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674447 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674450 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674452 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674455 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.682735 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674457 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674459 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674462 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674464 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674467 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674469 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674472 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674474 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674478 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674480 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674483 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674486 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674488 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674491 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674495 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674498 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674500 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674503 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674505 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674508 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.683506 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674510 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674513 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674516 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674518 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674521 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674523 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674526 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674528 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674531 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674534 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674537 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674539 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674543 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674546 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674549 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674552 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674554 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674556 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674559 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.684358 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674561 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674564 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674567 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674569 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674572 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674574 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674576 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674580 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674583 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674585 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674588 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674590 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674594 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674597 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674600 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674603 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674605 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674607 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674610 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674613 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.684957 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674615 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674618 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674620 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674624 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674626 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.674629 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.675405 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.683114 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.683135 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.683162 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.683171 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683255 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683262 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683267 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683272 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.685534 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683277 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683281 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683286 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683290 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683294 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683298 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683302 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683306 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683311 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683315 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683320 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683324 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683328 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683332 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683336 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683340 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683344 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683349 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683353 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683357 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.686159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683362 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683367 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683371 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683375 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683379 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683387 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683394 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683398 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683403 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683407 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683412 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683416 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683420 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683425 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683431 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683437 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683442 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683446 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683451 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.687058 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683455 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683459 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683463 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683467 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683472 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683476 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683480 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683484 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683489 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683493 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683497 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683501 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683505 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683509 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683513 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683516 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683520 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683524 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683528 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683534 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.687507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683539 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683543 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683547 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683551 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683555 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683559 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683564 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683568 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683572 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683577 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683581 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683585 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683589 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683594 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683598 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683602 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683607 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683611 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683615 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683619 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.688039 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683623 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683627 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683632 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683636 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683640 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683644 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683667 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683674 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683679 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683684 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683690 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683694 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683700 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683704 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683708 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.688507 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683712 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.683720 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683904 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683911 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683916 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683921 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683926 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683930 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683934 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683938 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683942 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683946 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683950 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683954 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 05 17:12:16.688888 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683959 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683963 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683967 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683971 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683975 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683979 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683984 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683988 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683992 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.683996 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684000 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684004 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684009 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684012 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684017 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684021 2558 feature_gate.go:328] unrecognized feature gate: Example2 Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684026 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684030 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684034 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684038 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 05 17:12:16.689218 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684042 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684046 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684051 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684055 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684059 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684063 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684067 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684071 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684075 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684079 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684083 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684087 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684092 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684096 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684100 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684104 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684108 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684112 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684119 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 05 17:12:16.689703 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684124 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684129 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684133 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684137 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684142 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684146 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684151 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684156 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684160 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684164 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684170 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684175 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684180 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684184 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684189 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684193 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684197 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684201 2558 feature_gate.go:328] unrecognized feature gate: Example Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684205 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684211 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 05 17:12:16.690148 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684217 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684221 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684225 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684229 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684233 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684237 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684242 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684246 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684250 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684254 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684260 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684266 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684270 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684275 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684280 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684284 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684288 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684292 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684296 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 05 17:12:16.690622 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684301 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684306 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684310 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684314 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684319 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684323 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684326 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684333 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:16.684337 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.684345 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.684506 2558 server.go:962] "Client rotation is on, will bootstrap in background" Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.687436 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.689004 2558 server.go:1019] "Starting client certificate rotation" Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.689125 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:16.691142 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.689153 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 05 17:12:16.693783 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.693769 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:16.695001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.694985 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 05 17:12:16.705679 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.705658 2558 log.go:25] "Validated CRI v1 runtime API" Aug 05 17:12:16.710756 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.710733 2558 log.go:25] "Validated CRI v1 image API" Aug 05 17:12:16.711957 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.711939 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 05 17:12:16.716752 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.716734 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 891bf8f4-a720-48f0-9a96-6d2dcd8f07ae:/dev/nvme0n1p4 cc30799d-e16d-4b9e-9106-5138f1bd5dab:/dev/nvme0n1p3] Aug 05 17:12:16.716796 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.716753 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 05 17:12:16.723001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.722889 2558 manager.go:216] Machine: {Timestamp:2026-08-05 17:12:16.72039644 +0000 UTC m=+0.379306203 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3204961 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec222e53ce5a93bc5e60ee90e13dcfc8 SystemUUID:ec222e53-ce5a-93bc-5e60-ee90e13dcfc8 BootID:3454f3af-df93-4728-a79c-c4126133c7cf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:d1:77:78:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:d1:77:78:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:cd:2f:b6:c1:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 05 17:12:16.723001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.722991 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 05 17:12:16.723118 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.723074 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 05 17:12:16.724164 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.724139 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 05 17:12:16.724298 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.724166 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 05 17:12:16.725551 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.725540 2558 topology_manager.go:138] "Creating topology manager with none policy" Aug 05 17:12:16.725586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.725554 2558 container_manager_linux.go:309] "Creating device plugin manager" Aug 05 17:12:16.725586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.725561 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:16.726352 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.726341 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 05 17:12:16.727351 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.727334 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:16.727479 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.727468 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 05 17:12:16.731319 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731308 2558 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:16.731442 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731432 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 05 17:12:16.731478 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731471 2558 kubelet.go:486] "Attempting to sync node with API server" Aug 05 17:12:16.731507 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731484 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 05 17:12:16.731507 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731499 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 05 17:12:16.731586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731508 2558 kubelet.go:398] "Adding apiserver pod source" Aug 05 17:12:16.731586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731518 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 05 17:12:16.731885 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731874 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:16.731917 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.731892 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 05 17:12:16.734411 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.734396 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 05 17:12:16.736172 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.736158 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 05 17:12:16.736247 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.736188 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 05 17:12:16.737562 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737549 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 05 17:12:16.737610 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737567 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 05 17:12:16.737610 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737576 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 05 17:12:16.737610 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737586 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 05 17:12:16.737610 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737599 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 05 17:12:16.737610 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737607 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737619 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737627 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737635 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737643 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737682 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 05 17:12:16.737773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.737691 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 05 17:12:16.738463 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.738450 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 05 17:12:16.738463 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.738464 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 05 17:12:16.741634 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.741620 2558 server.go:1268] "Started kubelet" Aug 05 17:12:16.741722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.741690 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 05 17:12:16.742162 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.742107 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 05 17:12:16.742239 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.742186 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 05 17:12:16.742485 ip-10-0-135-121 systemd[1]: Started Kubernetes Kubelet. Aug 05 17:12:16.743868 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.743787 2558 server.go:310] "Adding debug handlers to kubelet server" Aug 05 17:12:16.744281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.744170 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 05 17:12:16.745050 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.745033 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 05 17:12:16.745366 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.745343 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 05 17:12:16.745420 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.745373 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 05 17:12:16.747456 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.747436 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 05 17:12:16.747783 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.746682 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c8f8014e1d2b96 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-08-05 17:12:16.741591958 +0000 UTC m=+0.400501721,LastTimestamp:2026-08-05 17:12:16.741591958 +0000 UTC m=+0.400501721,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}" Aug 05 17:12:16.750429 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.750415 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 05 17:12:16.750429 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.750424 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:16.750536 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.750513 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:16.751132 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751116 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 05 17:12:16.751132 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751118 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 05 17:12:16.751261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751142 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 05 17:12:16.751261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751231 2558 reconstruct.go:97] "Volume reconstruction finished" Aug 05 17:12:16.751261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751242 2558 reconciler.go:29] "Reconciler: start to sync state" Aug 05 17:12:16.751261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751248 2558 factory.go:55] Registering systemd factory Aug 05 17:12:16.751261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751261 2558 factory.go:223] Registration of the systemd container factory successfully Aug 05 17:12:16.751490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751473 2558 factory.go:153] Registering CRI-O factory Aug 05 17:12:16.751490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751491 2558 factory.go:223] Registration of the crio container factory successfully Aug 05 17:12:16.751638 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751540 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 05 17:12:16.751638 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751569 2558 factory.go:103] Registering Raw factory Aug 05 17:12:16.751638 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.751583 2558 manager.go:1196] Started watching for new ooms in manager Aug 05 17:12:16.753090 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.753070 2558 manager.go:349] Starting recovery of all containers Aug 05 17:12:16.758504 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.758481 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 05 17:12:16.758779 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.758759 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 05 17:12:16.763281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.763263 2558 manager.go:354] Recovery completed Aug 05 17:12:16.768174 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.768160 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.771001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.770970 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.771070 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.771021 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.771070 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.771038 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.772543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.772478 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 05 17:12:16.772543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.772491 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 05 17:12:16.772543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.772510 2558 state_mem.go:36] "Initialized new in-memory state store" Aug 05 17:12:16.772707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.772556 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.773314 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.773221 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c8f8014fdded5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-121.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-08-05 17:12:16.771001691 +0000 UTC m=+0.429911460,LastTimestamp:2026-08-05 17:12:16.771001691 +0000 UTC m=+0.429911460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}" Aug 05 17:12:16.773441 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.773424 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.773506 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.773457 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.773506 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.773468 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.774156 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.774144 2558 policy_none.go:49] "None policy: Start" Aug 05 17:12:16.774188 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.774165 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 05 17:12:16.774188 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.774175 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 05 17:12:16.775272 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.775260 2558 policy_none.go:47] "Start" Aug 05 17:12:16.782393 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.782311 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c8f8014fde5672 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-121.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-08-05 17:12:16.771028594 +0000 UTC m=+0.429938364,LastTimestamp:2026-08-05 17:12:16.771028594 +0000 UTC m=+0.429938364,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}" Aug 05 17:12:16.787523 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.787504 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kngj8" Aug 05 17:12:16.796287 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.796211 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-121.ec2.internal.18c8f8014fde9232 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-121.ec2.internal,UID:ip-10-0-135-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-121.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-121.ec2.internal,},FirstTimestamp:2026-08-05 17:12:16.77104389 +0000 UTC m=+0.429953663,LastTimestamp:2026-08-05 17:12:16.77104389 +0000 UTC m=+0.429953663,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-121.ec2.internal,}" Aug 05 17:12:16.797621 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.797604 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kngj8" Aug 05 17:12:16.800246 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800233 2558 manager.go:337] "Starting Device Plugin manager" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.800270 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800283 2558 server.go:87] "Starting device plugin registration server" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800531 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800541 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800713 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800805 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.800817 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.801592 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.801638 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.815917 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.817089 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.817127 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.817149 2558 kubelet.go:2448] "Starting kubelet main sync loop" Aug 05 17:12:16.818281 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.817184 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 05 17:12:16.820229 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.820213 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:16.901414 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.901365 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.902377 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.902354 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.902510 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.902394 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.902510 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.902409 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.902510 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.902437 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.909963 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.909944 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.910039 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.909971 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-121.ec2.internal\": node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:16.917305 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.917240 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"] Aug 05 17:12:16.917411 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.917315 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.918926 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.918910 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.919027 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.918942 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.919027 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.918955 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.920748 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.920733 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.920828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.920819 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.920882 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.920848 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.921445 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921425 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.921548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921454 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.921548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921467 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.921548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921481 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.921548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921503 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.921548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.921513 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.923346 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.923333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.923414 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.923358 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:16.924041 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.924026 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:16.924105 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.924058 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:16.924105 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.924070 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:16.926578 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.926558 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:16.952576 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.952553 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc138473677e6ba7951298e1c98d8360-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"dc138473677e6ba7951298e1c98d8360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.952681 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.952582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.952681 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:16.952601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.963230 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.963209 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal" Aug 05 17:12:16.966479 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:16.966464 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-121.ec2.internal\" not found" node="ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.026929 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.026899 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:17.053458 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.053530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.053530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053480 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc138473677e6ba7951298e1c98d8360-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"dc138473677e6ba7951298e1c98d8360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.053530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053524 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc138473677e6ba7951298e1c98d8360-config\") pod \"kube-apiserver-proxy-ip-10-0-135-121.ec2.internal\" (UID: \"dc138473677e6ba7951298e1c98d8360\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.053624 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053544 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.053624 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.053544 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9386a6ca452e10f74d143e66574ebff9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal\" (UID: \"9386a6ca452e10f74d143e66574ebff9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.128015 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.127852 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:17.228592 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.228524 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:17.267250 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.267222 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.270382 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:17.270365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:17.329300 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.329267 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:17.429812 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.429763 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:17.530377 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:17.530279 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.129786 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.129746 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.187274 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.187247 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 05 17:12:19.187672 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.187408 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 05 17:12:19.230554 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.230531 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.259670 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.259626 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:19.302828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.302726 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 17:07:18 +0000 UTC" deadline="2028-05-09 06:39:06.138147992 +0000 UTC" Aug 05 17:12:19.302828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.302776 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15421h26m46.835376877s" Aug 05 17:12:19.330772 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.330749 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.419291 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.419264 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 05 17:12:19.420324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.420309 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientMemory" Aug 05 17:12:19.420403 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.420339 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasNoDiskPressure" Aug 05 17:12:19.420403 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.420348 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeHasSufficientPID" Aug 05 17:12:19.433272 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.433252 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.533895 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.533865 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.611251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.611182 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:19.634445 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.634407 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.735129 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:19.735109 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-121.ec2.internal\" not found" Aug 05 17:12:19.740515 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:19.740479 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9386a6ca452e10f74d143e66574ebff9.slice/crio-cbf97a3533bb0eb328958f877a7f8a8714f66daaa585402678b5dfb590376700 WatchSource:0}: Error finding container cbf97a3533bb0eb328958f877a7f8a8714f66daaa585402678b5dfb590376700: Status 404 returned error can't find the container with id cbf97a3533bb0eb328958f877a7f8a8714f66daaa585402678b5dfb590376700 Aug 05 17:12:19.745879 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.745866 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:12:19.752556 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.752538 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:19.786705 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:19.786682 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc138473677e6ba7951298e1c98d8360.slice/crio-e792ec1125aea9daef9d8815f34ab23a9322cc39f561cf26cc8629b26e981382 WatchSource:0}: Error finding container e792ec1125aea9daef9d8815f34ab23a9322cc39f561cf26cc8629b26e981382: Status 404 returned error can't find the container with id e792ec1125aea9daef9d8815f34ab23a9322cc39f561cf26cc8629b26e981382 Aug 05 17:12:19.849681 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.849655 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" Aug 05 17:12:19.865466 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.865415 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:19.866572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.866561 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" Aug 05 17:12:19.876138 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:19.876122 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 05 17:12:20.204943 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.204866 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 05 17:12:20.231939 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.231912 2558 apiserver.go:52] "Watching apiserver" Aug 05 17:12:20.242246 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.242219 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 05 17:12:20.243590 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.243557 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-vcnpm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal","openshift-multus/multus-additional-cni-plugins-prjht","openshift-multus/multus-ff7z8","openshift-ovn-kubernetes/ovnkube-node-rd856","kube-system/global-pull-secret-syncer-njb6v","kube-system/konnectivity-agent-9zv7z","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc","openshift-cluster-node-tuning-operator/tuned-8xzc8","openshift-multus/network-metrics-daemon-lps6b","openshift-network-diagnostics/network-check-target-wxz44","openshift-network-operator/iptables-alerter-mcz29","kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal"] Aug 05 17:12:20.246031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.246006 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.249082 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.249054 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.249190 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.249155 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fd46s\"" Aug 05 17:12:20.249190 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.249166 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 05 17:12:20.249307 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.249199 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 05 17:12:20.249547 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.249528 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 05 17:12:20.251464 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.251442 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.251859 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.251842 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.252361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.252162 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jg4k4\"" Aug 05 17:12:20.252361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.252173 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 05 17:12:20.252361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.252187 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 05 17:12:20.252361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.252277 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 05 17:12:20.252607 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.252583 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.253442 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.253425 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.256740 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.256721 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.256818 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.256802 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:20.257400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.257210 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hhbh6\"" Aug 05 17:12:20.257400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.257279 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 05 17:12:20.258928 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.258624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.260353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.259953 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 05 17:12:20.260353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.260353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260154 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.260353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260225 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 05 17:12:20.260353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260317 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kssvc\"" Aug 05 17:12:20.260592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 05 17:12:20.260592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.260457 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 05 17:12:20.261040 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261020 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.261438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261275 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-daemon-config\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261339 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75pz\" (UniqueName: \"kubernetes.io/projected/a3bef19f-18f2-4143-8d2f-500712b42ab4-kube-api-access-m75pz\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261369 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.261438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.261438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261425 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-cnibin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-multus\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-system-cni-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261517 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cnibin\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-netns\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261574 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-multus-certs\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-os-release\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261690 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-socket-dir-parent\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.261737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261720 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-etc-kubernetes\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261749 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-conf-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-cni-binary-copy\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261833 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cbb17e7-0039-49af-b9e9-de1976b5074a-agent-certs\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261863 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfm58\" (UniqueName: \"kubernetes.io/projected/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-kube-api-access-kfm58\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261895 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-system-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261917 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-os-release\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-bin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-kubelet\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.261986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-hostroot\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.262005 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cbb17e7-0039-49af-b9e9-de1976b5074a-konnectivity-ca\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.262034 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.262137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.262116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-k8s-cni-cncf-io\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.264849 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.263518 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.265134 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265115 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-brj7n\"" Aug 05 17:12:20.265364 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265345 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265618 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265809 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265868 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265903 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.265991 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 05 17:12:20.266131 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.266027 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.266470 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.266265 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.266470 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.266330 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:20.266933 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.266913 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wb6cr\"" Aug 05 17:12:20.267229 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.267156 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rjrh\"" Aug 05 17:12:20.267424 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.267407 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.267814 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.267780 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 05 17:12:20.269472 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.269452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:20.269565 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.269533 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:20.271716 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.271358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.275496 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.275176 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 05 17:12:20.275496 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.275257 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 05 17:12:20.275496 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.275365 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mf6jf\"" Aug 05 17:12:20.275496 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.275414 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:12:20.326197 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.326145 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"dc138473677e6ba7951298e1c98d8360","Type":"ContainerStarted","Data":"e792ec1125aea9daef9d8815f34ab23a9322cc39f561cf26cc8629b26e981382"} Aug 05 17:12:20.330430 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.330399 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"9386a6ca452e10f74d143e66574ebff9","Type":"ContainerStarted","Data":"cbf97a3533bb0eb328958f877a7f8a8714f66daaa585402678b5dfb590376700"} Aug 05 17:12:20.351168 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.351113 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363303 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tknqx\" (UniqueName: \"kubernetes.io/projected/9eec4881-9cad-427f-85f8-64005aa4d0cd-kube-api-access-tknqx\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-config\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363422 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d65e80cc-6d3d-4b57-9489-dec130c43c54-host\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363463 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-etc-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363542 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-socket-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-os-release\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363611 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-bin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363657 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-kubelet\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363809 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-systemd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.363834 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-device-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-modprobe-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-k8s-cni-cncf-io\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-systemd\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364321 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-host\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-daemon-config\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.365434 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364526 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75pz\" (UniqueName: \"kubernetes.io/projected/a3bef19f-18f2-4143-8d2f-500712b42ab4-kube-api-access-m75pz\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364592 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-bin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.364798 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-k8s-cni-cncf-io\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365274 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-os-release\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-script-lib\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365371 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7bg6\" (UniqueName: \"kubernetes.io/projected/da13f392-8652-4de4-a260-9fb0c690bf43-kube-api-access-l7bg6\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365388 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-daemon-config\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365448 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-cnibin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-systemd-units\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365648 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-cnibin\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-run\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365714 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-lib-modules\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-netns\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365830 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eec4881-9cad-427f-85f8-64005aa4d0cd-iptables-alerter-script\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.366233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365859 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eec4881-9cad-427f-85f8-64005aa4d0cd-host-slash\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365885 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-slash\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-conf\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.365934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366009 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5v2h\" (UniqueName: \"kubernetes.io/projected/d65e80cc-6d3d-4b57-9489-dec130c43c54-kube-api-access-d5v2h\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366059 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-tmp\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-conf-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366116 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-sys-fs\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-cni-binary-copy\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-bin\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-env-overrides\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-registration-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcxrl\" (UniqueName: \"kubernetes.io/projected/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-kube-api-access-wcxrl\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cbb17e7-0039-49af-b9e9-de1976b5074a-agent-certs\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfm58\" (UniqueName: \"kubernetes.io/projected/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-kube-api-access-kfm58\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-system-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.366945 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366550 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-netns\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366584 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-node-log\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366608 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-log-socket\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366652 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-tuned\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-kubelet\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-hostroot\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cbb17e7-0039-49af-b9e9-de1976b5074a-konnectivity-ca\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovn-node-metrics-cert\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-var-lib-kubelet\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpl52\" (UniqueName: \"kubernetes.io/projected/2f512846-c299-411d-b65c-a68dcc486b74-kube-api-access-cpl52\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysconfig\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-sys\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.366994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-dbus\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.367669 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-multus\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-var-lib-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367414 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-netd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d65e80cc-6d3d-4b57-9489-dec130c43c54-serviceca\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-system-cni-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367531 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cnibin\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-ovn\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-kubelet-config\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367611 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-etc-selinux\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-multus-certs\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-os-release\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-socket-dir-parent\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-etc-kubernetes\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-kubernetes\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.368341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2m87\" (UniqueName: \"kubernetes.io/projected/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-kube-api-access-t2m87\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.369060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.367866 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.369060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.368403 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-binary-copy\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.369060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.368458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-cni-multus\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.369060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.368749 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 05 17:12:20.369256 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369171 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.369772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369583 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-netns\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.369772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369330 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-hostroot\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.369772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369646 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-conf-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.369772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369668 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.369772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369719 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-system-cni-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369920 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369939 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cnibin\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.369987 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-var-lib-kubelet\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370028 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-host-run-multus-certs\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370064 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-etc-kubernetes\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-os-release\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.370572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370142 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a3bef19f-18f2-4143-8d2f-500712b42ab4-cni-binary-copy\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370198 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-multus-socket-dir-parent\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370352 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a3bef19f-18f2-4143-8d2f-500712b42ab4-system-cni-dir\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.370572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.370472 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0cbb17e7-0039-49af-b9e9-de1976b5074a-konnectivity-ca\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.371288 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.371266 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.374193 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.374170 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0cbb17e7-0039-49af-b9e9-de1976b5074a-agent-certs\") pod \"konnectivity-agent-9zv7z\" (UID: \"0cbb17e7-0039-49af-b9e9-de1976b5074a\") " pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.377359 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.376936 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75pz\" (UniqueName: \"kubernetes.io/projected/a3bef19f-18f2-4143-8d2f-500712b42ab4-kube-api-access-m75pz\") pod \"multus-ff7z8\" (UID: \"a3bef19f-18f2-4143-8d2f-500712b42ab4\") " pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.377359 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.377161 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2blps" Aug 05 17:12:20.380828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.380789 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfm58\" (UniqueName: \"kubernetes.io/projected/ef88c51e-70ff-4dbc-83d4-e7acf95501e4-kube-api-access-kfm58\") pod \"multus-additional-cni-plugins-prjht\" (UID: \"ef88c51e-70ff-4dbc-83d4-e7acf95501e4\") " pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.386550 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.386187 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2blps" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-netns\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-node-log\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-log-socket\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-tuned\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468258 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-netns\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovn-node-metrics-cert\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468276 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-node-log\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468313 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-log-socket\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-var-lib-kubelet\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468363 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpl52\" (UniqueName: \"kubernetes.io/projected/2f512846-c299-411d-b65c-a68dcc486b74-kube-api-access-cpl52\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468429 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-var-lib-kubelet\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysconfig\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.468369 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-sys\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.468697 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.468524 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:20.9684834 +0000 UTC m=+3.128410986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468483 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-dbus\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-var-lib-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-netd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d65e80cc-6d3d-4b57-9489-dec130c43c54-serviceca\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-ovn\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-kubelet-config\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468742 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-etc-selinux\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-kubernetes\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2m87\" (UniqueName: \"kubernetes.io/projected/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-kube-api-access-t2m87\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tknqx\" (UniqueName: \"kubernetes.io/projected/9eec4881-9cad-427f-85f8-64005aa4d0cd-kube-api-access-tknqx\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468864 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-etc-selinux\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-config\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d65e80cc-6d3d-4b57-9489-dec130c43c54-host\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.469617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-etc-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-socket-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.468980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-kubelet\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-systemd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469031 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-device-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469081 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-kubernetes\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-modprobe-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469113 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-systemd\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469135 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-host\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-script-lib\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7bg6\" (UniqueName: \"kubernetes.io/projected/da13f392-8652-4de4-a260-9fb0c690bf43-kube-api-access-l7bg6\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469213 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-systemd-units\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-run\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-lib-modules\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.470409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eec4881-9cad-427f-85f8-64005aa4d0cd-iptables-alerter-script\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eec4881-9cad-427f-85f8-64005aa4d0cd-host-slash\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469414 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-slash\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-conf\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469468 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-kubelet\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5v2h\" (UniqueName: \"kubernetes.io/projected/d65e80cc-6d3d-4b57-9489-dec130c43c54-kube-api-access-d5v2h\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469518 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-tmp\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-sys-fs\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469565 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-bin\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469590 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-env-overrides\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469613 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-registration-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469660 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcxrl\" (UniqueName: \"kubernetes.io/projected/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-kube-api-access-wcxrl\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469713 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysconfig\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469772 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-sys\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469831 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-dbus\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.471251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469872 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-var-lib-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469913 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-netd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469942 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-systemd\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.469991 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470047 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-device-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470144 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-modprobe-d\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470191 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-systemd\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470235 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-host\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470391 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d65e80cc-6d3d-4b57-9489-dec130c43c54-serviceca\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470458 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470503 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-run-ovn\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470558 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9678ee84-e4aa-4eae-bdbf-9e294941d737-kubelet-config\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470596 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d65e80cc-6d3d-4b57-9489-dec130c43c54-host\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470825 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-script-lib\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.470839 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-etc-openvswitch\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.470913 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.470968 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:20.970952937 +0000 UTC m=+3.130880508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:20.472012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471012 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-systemd-units\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471030 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovnkube-config\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471062 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-run\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471103 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-run-ovn-kubernetes\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471143 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-socket-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471197 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9eec4881-9cad-427f-85f8-64005aa4d0cd-host-slash\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471205 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-lib-modules\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471486 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-slash\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471619 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-sysctl-conf\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471708 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9eec4881-9cad-427f-85f8-64005aa4d0cd-iptables-alerter-script\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471769 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-host-cni-bin\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471789 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-sys-fs\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.471860 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2f512846-c299-411d-b65c-a68dcc486b74-registration-dir\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.472209 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-env-overrides\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.472840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.472808 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-ovn-node-metrics-cert\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.475354 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.475289 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-etc-tuned\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.475489 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.475471 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-tmp\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.493622 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.493579 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5v2h\" (UniqueName: \"kubernetes.io/projected/d65e80cc-6d3d-4b57-9489-dec130c43c54-kube-api-access-d5v2h\") pod \"node-ca-vcnpm\" (UID: \"d65e80cc-6d3d-4b57-9489-dec130c43c54\") " pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.494303 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.494283 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tknqx\" (UniqueName: \"kubernetes.io/projected/9eec4881-9cad-427f-85f8-64005aa4d0cd-kube-api-access-tknqx\") pod \"iptables-alerter-mcz29\" (UID: \"9eec4881-9cad-427f-85f8-64005aa4d0cd\") " pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.498606 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.498562 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcxrl\" (UniqueName: \"kubernetes.io/projected/2a74dbb3-fb47-4433-b0e0-3e29afa5a303-kube-api-access-wcxrl\") pod \"ovnkube-node-rd856\" (UID: \"2a74dbb3-fb47-4433-b0e0-3e29afa5a303\") " pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.498724 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.498644 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:20.498724 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.498667 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:20.498724 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.498680 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:20.498878 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.498742 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:20.998724824 +0000 UTC m=+3.158652409 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:20.499123 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.499099 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7bg6\" (UniqueName: \"kubernetes.io/projected/da13f392-8652-4de4-a260-9fb0c690bf43-kube-api-access-l7bg6\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.500062 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.500020 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpl52\" (UniqueName: \"kubernetes.io/projected/2f512846-c299-411d-b65c-a68dcc486b74-kube-api-access-cpl52\") pod \"aws-ebs-csi-driver-node-ppvxc\" (UID: \"2f512846-c299-411d-b65c-a68dcc486b74\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.500678 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.500628 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2m87\" (UniqueName: \"kubernetes.io/projected/5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db-kube-api-access-t2m87\") pod \"tuned-8xzc8\" (UID: \"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db\") " pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.559119 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.559089 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:20.570520 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.570393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-prjht" Aug 05 17:12:20.570889 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.570859 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cbb17e7_0039_49af_b9e9_de1976b5074a.slice/crio-aa17a9359c7be2b657f63515f549372257203aecd387e41f20a255b51362c65f WatchSource:0}: Error finding container aa17a9359c7be2b657f63515f549372257203aecd387e41f20a255b51362c65f: Status 404 returned error can't find the container with id aa17a9359c7be2b657f63515f549372257203aecd387e41f20a255b51362c65f Aug 05 17:12:20.580380 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.580221 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff7z8" Aug 05 17:12:20.580610 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.580581 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef88c51e_70ff_4dbc_83d4_e7acf95501e4.slice/crio-b08bb001845b2a50f8ff58f9feae37cb562171593f7490bc6965aa035d12ed89 WatchSource:0}: Error finding container b08bb001845b2a50f8ff58f9feae37cb562171593f7490bc6965aa035d12ed89: Status 404 returned error can't find the container with id b08bb001845b2a50f8ff58f9feae37cb562171593f7490bc6965aa035d12ed89 Aug 05 17:12:20.586033 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.586005 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:20.594958 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.594804 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcnpm" Aug 05 17:12:20.597280 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.597257 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a74dbb3_fb47_4433_b0e0_3e29afa5a303.slice/crio-c58596091d332dafbfc243d91277d7099e315ce9259142eead993817b40ccbd8 WatchSource:0}: Error finding container c58596091d332dafbfc243d91277d7099e315ce9259142eead993817b40ccbd8: Status 404 returned error can't find the container with id c58596091d332dafbfc243d91277d7099e315ce9259142eead993817b40ccbd8 Aug 05 17:12:20.603487 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.603464 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" Aug 05 17:12:20.605924 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.605900 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65e80cc_6d3d_4b57_9489_dec130c43c54.slice/crio-2113b023e3c6ebbc8ae08a9ed4c088d71b74a75196141aac30ff049c8b43de04 WatchSource:0}: Error finding container 2113b023e3c6ebbc8ae08a9ed4c088d71b74a75196141aac30ff049c8b43de04: Status 404 returned error can't find the container with id 2113b023e3c6ebbc8ae08a9ed4c088d71b74a75196141aac30ff049c8b43de04 Aug 05 17:12:20.611802 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.611660 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" Aug 05 17:12:20.613139 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.613106 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f512846_c299_411d_b65c_a68dcc486b74.slice/crio-21528e87ecc8eda6feae8ce773b65e6cafb2c1d390c2745e6f734b6bb67f8dc9 WatchSource:0}: Error finding container 21528e87ecc8eda6feae8ce773b65e6cafb2c1d390c2745e6f734b6bb67f8dc9: Status 404 returned error can't find the container with id 21528e87ecc8eda6feae8ce773b65e6cafb2c1d390c2745e6f734b6bb67f8dc9 Aug 05 17:12:20.619059 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.618900 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mcz29" Aug 05 17:12:20.622786 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.622748 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7cb1c9_a10b_4acc_92c8_e0d7c524d5db.slice/crio-6aa508021aa498e16765264e3ad55bc35d8b9bffab2af2c018cf14d3793ef309 WatchSource:0}: Error finding container 6aa508021aa498e16765264e3ad55bc35d8b9bffab2af2c018cf14d3793ef309: Status 404 returned error can't find the container with id 6aa508021aa498e16765264e3ad55bc35d8b9bffab2af2c018cf14d3793ef309 Aug 05 17:12:20.629008 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:20.628986 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eec4881_9cad_427f_85f8_64005aa4d0cd.slice/crio-2fda5db08c9472462d3111a66711b27c7bfd722bc826304c196363d93f10008a WatchSource:0}: Error finding container 2fda5db08c9472462d3111a66711b27c7bfd722bc826304c196363d93f10008a: Status 404 returned error can't find the container with id 2fda5db08c9472462d3111a66711b27c7bfd722bc826304c196363d93f10008a Aug 05 17:12:20.972646 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.972612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:20.972817 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.972781 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:20.972872 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:20.972783 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:20.972872 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.972849 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:20.972971 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.972855 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:21.972835151 +0000 UTC m=+4.132762732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:20.972971 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:20.972904 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:21.972893677 +0000 UTC m=+4.132821246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:21.073976 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.073939 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:21.074150 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.074092 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:21.074150 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.074120 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:21.074150 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.074134 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:21.074309 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.074190 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:22.074175463 +0000 UTC m=+4.234103045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:21.316975 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.316886 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:21.317678 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.317034 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:21.334237 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.334201 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff7z8" event={"ID":"a3bef19f-18f2-4143-8d2f-500712b42ab4","Type":"ContainerStarted","Data":"bb5c71626a5ec4938fe45744f9aeb6ddccfa8940371286857697d20b936c6750"} Aug 05 17:12:21.335277 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.335246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerStarted","Data":"b08bb001845b2a50f8ff58f9feae37cb562171593f7490bc6965aa035d12ed89"} Aug 05 17:12:21.336181 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.336160 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" event={"ID":"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db","Type":"ContainerStarted","Data":"6aa508021aa498e16765264e3ad55bc35d8b9bffab2af2c018cf14d3793ef309"} Aug 05 17:12:21.337106 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.337087 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcnpm" event={"ID":"d65e80cc-6d3d-4b57-9489-dec130c43c54","Type":"ContainerStarted","Data":"2113b023e3c6ebbc8ae08a9ed4c088d71b74a75196141aac30ff049c8b43de04"} Aug 05 17:12:21.338086 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.338067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"c58596091d332dafbfc243d91277d7099e315ce9259142eead993817b40ccbd8"} Aug 05 17:12:21.339436 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.339418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9zv7z" event={"ID":"0cbb17e7-0039-49af-b9e9-de1976b5074a","Type":"ContainerStarted","Data":"aa17a9359c7be2b657f63515f549372257203aecd387e41f20a255b51362c65f"} Aug 05 17:12:21.340293 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.340276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcz29" event={"ID":"9eec4881-9cad-427f-85f8-64005aa4d0cd","Type":"ContainerStarted","Data":"2fda5db08c9472462d3111a66711b27c7bfd722bc826304c196363d93f10008a"} Aug 05 17:12:21.341180 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.341161 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" event={"ID":"2f512846-c299-411d-b65c-a68dcc486b74","Type":"ContainerStarted","Data":"21528e87ecc8eda6feae8ce773b65e6cafb2c1d390c2745e6f734b6bb67f8dc9"} Aug 05 17:12:21.390471 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.390428 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:20 +0000 UTC" deadline="2028-05-18 14:03:23.143137356 +0000 UTC" Aug 05 17:12:21.390471 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.390472 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15644h51m1.752673437s" Aug 05 17:12:21.983599 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.983278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:21.983599 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.983553 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:21.983825 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:21.983612 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:21.983825 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.983649 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:23.983614555 +0000 UTC m=+6.143542127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:21.983825 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.983744 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:21.983825 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:21.983796 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:23.983781084 +0000 UTC m=+6.143708655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:22.085841 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.084813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:22.085841 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.084973 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:22.085841 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.084994 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:22.085841 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.085005 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:22.085841 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.085062 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:24.085045622 +0000 UTC m=+6.244973207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:22.318587 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.318522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:22.319195 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.318673 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:22.319195 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.318757 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:22.319195 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:22.318834 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:22.359136 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.359100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" event={"ID":"dc138473677e6ba7951298e1c98d8360","Type":"ContainerStarted","Data":"6f70cb4efda380659af2e4fc9454a07213821b56f18f38d6bf5baee3a2a20498"} Aug 05 17:12:22.374601 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.373477 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-121.ec2.internal" podStartSLOduration=3.373459335 podStartE2EDuration="3.373459335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:22.373205049 +0000 UTC m=+4.533132642" watchObservedRunningTime="2026-08-05 17:12:22.373459335 +0000 UTC m=+4.533386927" Aug 05 17:12:22.391078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.391027 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 17:07:20 +0000 UTC" deadline="2028-01-19 07:09:13.861053403 +0000 UTC" Aug 05 17:12:22.391078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:22.391059 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12757h56m51.46999903s" Aug 05 17:12:23.317252 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:23.317170 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:23.317430 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:23.317310 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:23.378455 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:23.377573 2558 generic.go:356] "Generic (PLEG): container finished" podID="9386a6ca452e10f74d143e66574ebff9" containerID="31463392e62aad46e4066027c0cc76b01d19c84ccc64b7e69e423832057827d9" exitCode=0 Aug 05 17:12:23.378927 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:23.378603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"9386a6ca452e10f74d143e66574ebff9","Type":"ContainerDied","Data":"31463392e62aad46e4066027c0cc76b01d19c84ccc64b7e69e423832057827d9"} Aug 05 17:12:24.000924 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:24.000896 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:24.001108 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:24.000957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:24.001108 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.001102 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:24.001221 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.001162 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:28.001145063 +0000 UTC m=+10.161072646 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:24.001472 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.001395 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:24.001472 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.001452 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:28.001436241 +0000 UTC m=+10.161363824 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:24.101477 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:24.101440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:24.102070 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.102051 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:24.102162 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.102077 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:24.102162 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.102090 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:24.102264 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.102161 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:28.102141567 +0000 UTC m=+10.262069150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:24.319499 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:24.319424 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:24.319668 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.319565 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:24.319668 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:24.319620 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:24.319783 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:24.319711 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:25.317428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:25.317389 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:25.317922 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:25.317530 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:26.317628 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:26.317075 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:26.317628 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:26.317279 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:26.317628 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:26.317329 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:26.317628 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:26.317444 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:27.316445 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:27.316353 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:27.316619 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:27.316495 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:28.035712 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:28.035672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:28.036101 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:28.035752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:28.036101 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.035811 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:28.036101 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.035849 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:28.036101 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.035882 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:36.035863646 +0000 UTC m=+18.195791233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:28.036101 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.035902 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:36.035891949 +0000 UTC m=+18.195819523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:28.136423 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:28.136386 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:28.136616 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.136581 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:28.136616 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.136604 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:28.136616 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.136615 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:28.136773 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.136690 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:36.136670413 +0000 UTC m=+18.296598003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:28.317528 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:28.317456 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:28.317700 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.317562 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:28.317700 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:28.317652 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:28.317817 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:28.317744 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:29.316651 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:29.316612 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:29.317100 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:29.316740 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:30.121708 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.121673 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-b6fj4"] Aug 05 17:12:30.124616 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.124588 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.131469 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.131445 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 05 17:12:30.131794 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.131768 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 05 17:12:30.132576 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.132557 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-trblj\"" Aug 05 17:12:30.254074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.253982 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rgz\" (UniqueName: \"kubernetes.io/projected/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-kube-api-access-28rgz\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.254074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.254070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-hosts-file\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.254332 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.254122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-tmp-dir\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.317080 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.317033 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:30.317507 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:30.317166 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:30.317507 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.317212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:30.317507 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:30.317329 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:30.354619 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.354586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-hosts-file\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.354792 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.354656 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-tmp-dir\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.354792 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.354716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rgz\" (UniqueName: \"kubernetes.io/projected/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-kube-api-access-28rgz\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.354792 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.354736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-hosts-file\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.354950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.354910 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-tmp-dir\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.369353 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.369315 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rgz\" (UniqueName: \"kubernetes.io/projected/27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83-kube-api-access-28rgz\") pod \"node-resolver-b6fj4\" (UID: \"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83\") " pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:30.433174 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:30.433094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b6fj4" Aug 05 17:12:31.317395 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:31.317313 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:31.317840 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:31.317442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:32.317138 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:32.317103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:32.317324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:32.317155 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:32.317324 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:32.317229 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:32.317415 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:32.317354 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:33.317310 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:33.317274 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:33.317487 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:33.317399 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:34.316899 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:34.316861 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:34.317069 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:34.316860 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:34.317069 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:34.317015 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:34.317194 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:34.317074 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:35.317402 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:35.317363 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:35.317945 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:35.317499 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:36.094543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:36.094494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:36.094839 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:36.094578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:36.094839 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.094686 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:36.094839 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.094706 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:36.094839 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.094768 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:52.094747315 +0000 UTC m=+34.254674885 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:36.094839 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.094784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:52.094777737 +0000 UTC m=+34.254705306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:36.195029 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:36.194986 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:36.195215 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.195148 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:36.195215 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.195172 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:36.195215 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.195185 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:36.195347 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.195249 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:12:52.195231225 +0000 UTC m=+34.355158814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:36.316942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:36.316908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:36.316942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:36.316939 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:36.317184 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.317040 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:36.317184 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:36.317136 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:37.317165 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:37.317122 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:37.317569 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:37.317263 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:38.317048 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:38.317018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:38.317244 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:38.317138 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:38.317610 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:38.317243 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:38.317610 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:38.317133 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:38.956889 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:38.956818 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27f3a2bb_ebfe_4fd8_aa0a_63c9f5fdbe83.slice/crio-e3906ddc1b1bca90538511b1fe866504e05775cc89decfce1ece0e1e36c5fe2b WatchSource:0}: Error finding container e3906ddc1b1bca90538511b1fe866504e05775cc89decfce1ece0e1e36c5fe2b: Status 404 returned error can't find the container with id e3906ddc1b1bca90538511b1fe866504e05775cc89decfce1ece0e1e36c5fe2b Aug 05 17:12:39.317251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.317070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:39.317720 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:39.317358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:39.409828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.409798 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" event={"ID":"9386a6ca452e10f74d143e66574ebff9","Type":"ContainerStarted","Data":"83d5d7cdf56f90f79aa61bb019473a22bc4d0b564939332b3da4f5289d221c1a"} Aug 05 17:12:39.411594 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.411566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" event={"ID":"2f512846-c299-411d-b65c-a68dcc486b74","Type":"ContainerStarted","Data":"a788dc0b5be460348d4f79f18be60c76b95d40f4799ff918d9103dd9c59da94c"} Aug 05 17:12:39.413193 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.413113 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="b15ec859ff32707d1a9694cf816e7541522ae8eb285c07b4f7342094b1f1268b" exitCode=0 Aug 05 17:12:39.413326 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.413186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"b15ec859ff32707d1a9694cf816e7541522ae8eb285c07b4f7342094b1f1268b"} Aug 05 17:12:39.414953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.414933 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6fj4" event={"ID":"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83","Type":"ContainerStarted","Data":"3e16cc2789340f044131d73bdfb44c3ff862167efc177f7985110e49010b4373"} Aug 05 17:12:39.415013 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.414967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b6fj4" event={"ID":"27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83","Type":"ContainerStarted","Data":"e3906ddc1b1bca90538511b1fe866504e05775cc89decfce1ece0e1e36c5fe2b"} Aug 05 17:12:39.416382 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.416363 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" event={"ID":"5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db","Type":"ContainerStarted","Data":"e0b0c25395ffcf4ddd8ad3cab054d182ec6969c096cef1031633da3dd2924ee9"} Aug 05 17:12:39.417719 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.417699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcnpm" event={"ID":"d65e80cc-6d3d-4b57-9489-dec130c43c54","Type":"ContainerStarted","Data":"77aad76c24480387aa18fc06ac8cfed260fc8541314655d42b39776f5119367e"} Aug 05 17:12:39.419668 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.419650 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:12:39.421696 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.421672 2558 generic.go:356] "Generic (PLEG): container finished" podID="2a74dbb3-fb47-4433-b0e0-3e29afa5a303" containerID="fcdb77d4031c10a9d2c9c7ac4b03571ee16017a0c925a6bebaa27e2700016cc5" exitCode=1 Aug 05 17:12:39.421799 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.421738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"6d85aa9e3022683cf66d457c06b228dc69ccac05cd5ed8cc688046ecc24a32e4"} Aug 05 17:12:39.421861 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.421801 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerDied","Data":"fcdb77d4031c10a9d2c9c7ac4b03571ee16017a0c925a6bebaa27e2700016cc5"} Aug 05 17:12:39.421861 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.421851 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"71671052329f69d6ec44637f0b38c72dcf8bc68b20c7ef5758d2fda678e47e5a"} Aug 05 17:12:39.423599 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.423577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9zv7z" event={"ID":"0cbb17e7-0039-49af-b9e9-de1976b5074a","Type":"ContainerStarted","Data":"37dac736b62af89474d842d589a99fb2d1fa5054980afcb3dad778d84352e7f7"} Aug 05 17:12:39.430207 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.430157 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-121.ec2.internal" podStartSLOduration=20.430141051 podStartE2EDuration="20.430141051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:39.429514093 +0000 UTC m=+21.589441683" watchObservedRunningTime="2026-08-05 17:12:39.430141051 +0000 UTC m=+21.590068644" Aug 05 17:12:39.449799 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.449736 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8xzc8" podStartSLOduration=3.153938958 podStartE2EDuration="21.449716842s" totalImagesPullingTime="18.295777884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:39.448839811 +0000 UTC m=+21.608767402" watchObservedRunningTime="2026-08-05 17:12:39.449716842 +0000 UTC m=+21.609644433" Aug 05 17:12:39.465718 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.465666 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b6fj4" podStartSLOduration=9.465647994 podStartE2EDuration="9.465647994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:39.464086257 +0000 UTC m=+21.624013858" watchObservedRunningTime="2026-08-05 17:12:39.465647994 +0000 UTC m=+21.625575584" Aug 05 17:12:39.518615 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:39.518571 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9zv7z" podStartSLOduration=3.169349322 podStartE2EDuration="21.518556477s" totalImagesPullingTime="18.349207155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:39.483422194 +0000 UTC m=+21.643349839" watchObservedRunningTime="2026-08-05 17:12:39.518556477 +0000 UTC m=+21.678484068" Aug 05 17:12:40.316708 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.316675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:40.316866 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.316716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:40.316866 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:40.316792 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:40.316935 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:40.316897 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:40.428250 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.428219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mcz29" event={"ID":"9eec4881-9cad-427f-85f8-64005aa4d0cd","Type":"ContainerStarted","Data":"24089342de82ad7c2e4a11ded4bc03e025fbaceaf07cbb0bad54b014ffbdfa10"} Aug 05 17:12:40.429955 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.429926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff7z8" event={"ID":"a3bef19f-18f2-4143-8d2f-500712b42ab4","Type":"ContainerStarted","Data":"fa5dec7b1311f8678479bb7edca7ca41bf320d719745c4e95a0e77fef280db62"} Aug 05 17:12:40.433047 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.433027 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:12:40.433532 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.433502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"a1b3fd84c7e54b193b21ef24e64ea53d814a94037de13ad00bd5b3f09db742bf"} Aug 05 17:12:40.433622 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.433582 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"abb8f912efcdf954453c6409f06c50d8d9aa6a808c20cfcc333abe26c522daf2"} Aug 05 17:12:40.433692 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.433648 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"0ed511af5e7d0b7d9573a506cc70de318ba22c680a4283cd09ef6038ccf7ba86"} Aug 05 17:12:40.465184 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.465141 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mcz29" podStartSLOduration=4.145961052 podStartE2EDuration="22.465121933s" totalImagesPullingTime="18.319160881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:40.464765682 +0000 UTC m=+22.624693274" watchObservedRunningTime="2026-08-05 17:12:40.465121933 +0000 UTC m=+22.625049550" Aug 05 17:12:40.465339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.465255 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vcnpm" podStartSLOduration=4.123194065 podStartE2EDuration="22.465248242s" totalImagesPullingTime="18.342054177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:39.547223635 +0000 UTC m=+21.707151227" watchObservedRunningTime="2026-08-05 17:12:40.465248242 +0000 UTC m=+22.625175835" Aug 05 17:12:40.494554 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:40.494531 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 05 17:12:41.314557 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:41.314413 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T17:12:40.49454833Z","UUID":"26760807-51e8-4b1f-92b9-d5aa9050c929","Handler":null,"Name":"","Endpoint":""} Aug 05 17:12:41.316277 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:41.316248 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:41.316422 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:41.316346 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:41.316490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:41.316423 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 05 17:12:41.316490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:41.316463 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 05 17:12:41.438242 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:41.438200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" event={"ID":"2f512846-c299-411d-b65c-a68dcc486b74","Type":"ContainerStarted","Data":"1d96534e70a1204d49fcb1514fa67b199d6f709c36d4bd42517023f5aca63143"} Aug 05 17:12:42.316823 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.316589 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:42.317215 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.316622 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:42.317215 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:42.316923 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:42.317215 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:42.316952 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:42.444028 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.443999 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:12:42.444451 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.444423 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"5c06cae467c33e2afa7b3df006ba6a6d9d647e52f2b75b025a52065d3c33d313"} Aug 05 17:12:42.446574 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.446546 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" event={"ID":"2f512846-c299-411d-b65c-a68dcc486b74","Type":"ContainerStarted","Data":"c5c2452fb860f6f494b5b1cb7d0081302e54ca2f0a5ff00e216ecb189e7f95c7"} Aug 05 17:12:42.470076 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.470021 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ppvxc" podStartSLOduration=3.857189005 podStartE2EDuration="24.470007001s" totalImagesPullingTime="20.612817996s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:42.469615979 +0000 UTC m=+24.629543571" watchObservedRunningTime="2026-08-05 17:12:42.470007001 +0000 UTC m=+24.629934592" Aug 05 17:12:42.470445 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:42.470422 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ff7z8" podStartSLOduration=5.712997926 podStartE2EDuration="24.470414141s" totalImagesPullingTime="18.757416215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:40.499932072 +0000 UTC m=+22.659859663" watchObservedRunningTime="2026-08-05 17:12:42.470414141 +0000 UTC m=+24.630341784" Aug 05 17:12:43.225872 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:43.225842 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:43.226455 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:43.226434 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:43.316767 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:43.316735 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:43.316935 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:43.316870 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:43.449449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:43.449408 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:43.450137 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:43.449926 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9zv7z" Aug 05 17:12:44.317585 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.317388 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:44.317861 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.317462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:44.317861 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:44.317710 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:44.317861 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:44.317725 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:44.452926 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.452893 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="3a8c4daed650c8fb215c1d3f5f9dd01204c52fa65f7c37a58e516a09186360b6" exitCode=0 Aug 05 17:12:44.453616 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.452974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"3a8c4daed650c8fb215c1d3f5f9dd01204c52fa65f7c37a58e516a09186360b6"} Aug 05 17:12:44.456676 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.456658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:12:44.457034 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.457010 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"634bba084625b7d60f38740beef6d983339e4b1eb82c1b6a162da768e21197c7"} Aug 05 17:12:44.457263 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.457232 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:44.457401 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.457386 2558 scope.go:117] "RemoveContainer" containerID="fcdb77d4031c10a9d2c9c7ac4b03571ee16017a0c925a6bebaa27e2700016cc5" Aug 05 17:12:44.472784 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:44.472761 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:45.316994 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.316958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:45.317250 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:45.317069 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:45.464582 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.464552 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:12:45.465785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.465561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" event={"ID":"2a74dbb3-fb47-4433-b0e0-3e29afa5a303","Type":"ContainerStarted","Data":"046753cd01971a8205bf1afcd2dd388a8a2e11bc9246d66a9c344a560d7110b0"} Aug 05 17:12:45.465785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.465675 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:45.465785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.465728 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:45.491167 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.491135 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:12:45.499583 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:45.499502 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" podStartSLOduration=9.115704126 podStartE2EDuration="27.499480285s" totalImagesPullingTime="18.383776159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:45.498007939 +0000 UTC m=+27.657935535" watchObservedRunningTime="2026-08-05 17:12:45.499480285 +0000 UTC m=+27.659407877" Aug 05 17:12:46.317020 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.316990 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:46.317170 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.316992 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:46.317170 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:46.317103 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:46.317250 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:46.317215 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:46.469408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.469318 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="dc4fc12585c17c9ae9d8c57b50ff498ccf561b68b4a7974c5eb0d98454d746f7" exitCode=0 Aug 05 17:12:46.469816 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.469412 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"dc4fc12585c17c9ae9d8c57b50ff498ccf561b68b4a7974c5eb0d98454d746f7"} Aug 05 17:12:46.621777 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.621741 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njb6v"] Aug 05 17:12:46.621942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.621883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:46.622029 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:46.622003 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:46.625599 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.625575 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lps6b"] Aug 05 17:12:46.625733 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.625678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:46.625793 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:46.625761 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:46.628515 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.628491 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxz44"] Aug 05 17:12:46.628615 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:46.628570 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:46.628705 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:46.628678 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:48.317869 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:48.317678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:48.318259 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:48.317740 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:48.318259 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:48.317943 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:48.318259 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:48.318010 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:48.318259 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:48.317757 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:48.318259 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:48.318121 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:48.476191 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:48.476151 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="a6a88bc360c4b7c5f360ee13b9004a97af08eeff8732e1b802a13199c87feb29" exitCode=0 Aug 05 17:12:48.476354 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:48.476217 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"a6a88bc360c4b7c5f360ee13b9004a97af08eeff8732e1b802a13199c87feb29"} Aug 05 17:12:50.320486 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:50.320430 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:50.320486 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:50.320461 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:50.320486 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:50.320461 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:50.321310 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:50.320545 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wxz44" podUID="d6cae1ea-352a-4289-9337-210a0a10178d" Aug 05 17:12:50.321310 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:50.320624 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:12:50.321310 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:50.320718 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-njb6v" podUID="9678ee84-e4aa-4eae-bdbf-9e294941d737" Aug 05 17:12:52.112096 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.111997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:52.112564 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.112098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:52.112564 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.112185 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:52.112564 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.112218 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:52.112564 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.112263 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:24.112243231 +0000 UTC m=+66.272170820 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 05 17:12:52.112564 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.112284 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret podName:9678ee84-e4aa-4eae-bdbf-9e294941d737 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:24.112273762 +0000 UTC m=+66.272201335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret") pod "global-pull-secret-syncer-njb6v" (UID: "9678ee84-e4aa-4eae-bdbf-9e294941d737") : object "kube-system"/"original-pull-secret" not registered Aug 05 17:12:52.163713 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.163667 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-121.ec2.internal" event="NodeReady" Aug 05 17:12:52.163876 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.163842 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 05 17:12:52.202939 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.202909 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:12:52.205653 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.205535 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.208486 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.208460 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Aug 05 17:12:52.208996 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.208977 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Aug 05 17:12:52.209118 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.209058 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4tv2\"" Aug 05 17:12:52.209118 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.209074 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Aug 05 17:12:52.212701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.212677 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:52.212812 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.212800 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 05 17:12:52.212886 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.212816 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 05 17:12:52.212886 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.212827 2558 projected.go:196] Error preparing data for projected volume kube-api-access-r9ct8 for pod openshift-network-diagnostics/network-check-target-wxz44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:52.212984 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.212894 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8 podName:d6cae1ea-352a-4289-9337-210a0a10178d nodeName:}" failed. No retries permitted until 2026-08-05 17:13:24.212877025 +0000 UTC m=+66.372804609 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r9ct8" (UniqueName: "kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8") pod "network-check-target-wxz44" (UID: "d6cae1ea-352a-4289-9337-210a0a10178d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 05 17:12:52.214536 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.214453 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Aug 05 17:12:52.215563 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.215542 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lm8mt"] Aug 05 17:12:52.217289 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.217264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.219920 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.219901 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 05 17:12:52.220425 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.220406 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxp5d\"" Aug 05 17:12:52.220575 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.220560 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 05 17:12:52.221874 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.221855 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-79gsb"] Aug 05 17:12:52.223564 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.223546 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:12:52.223684 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.223656 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.226675 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.226088 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 05 17:12:52.226675 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.226136 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7qph7\"" Aug 05 17:12:52.226675 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.226253 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 05 17:12:52.226675 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.226544 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 05 17:12:52.229964 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.229944 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lm8mt"] Aug 05 17:12:52.240379 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.240361 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-79gsb"] Aug 05 17:12:52.313209 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313176 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313209 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313233 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjwxw\" (UniqueName: \"kubernetes.io/projected/364c8073-052c-488d-ba47-72bd1eeb97ab-kube-api-access-fjwxw\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.313454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7caf090-1cf9-453a-abd4-abf713ba136c-config-volume\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.313454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.313454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313452 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96rr4\" (UniqueName: \"kubernetes.io/projected/f7caf090-1cf9-453a-abd4-abf713ba136c-kube-api-access-96rr4\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313478 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9462\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364c8073-052c-488d-ba47-72bd1eeb97ab-cert\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.313762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.313677 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7caf090-1cf9-453a-abd4-abf713ba136c-tmp-dir\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.317285 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.317260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:12:52.317369 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.317260 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:12:52.317553 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.317533 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:12:52.319798 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.319778 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:12:52.320121 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.320095 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:12:52.320243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.320125 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8bnx\"" Aug 05 17:12:52.320243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.320150 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:12:52.320243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.320168 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9xpb\"" Aug 05 17:12:52.320243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.320102 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:12:52.414801 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.414898 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414808 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96rr4\" (UniqueName: \"kubernetes.io/projected/f7caf090-1cf9-453a-abd4-abf713ba136c-kube-api-access-96rr4\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.414898 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.414898 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9462\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.414898 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.414898 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364c8073-052c-488d-ba47-72bd1eeb97ab-cert\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.415074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414917 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414936 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7caf090-1cf9-453a-abd4-abf713ba136c-tmp-dir\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.415074 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.414976 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:12:52.415074 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.415049 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:12:52.915028412 +0000 UTC m=+35.074956008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:12:52.415296 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.414979 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415296 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415296 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415240 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415296 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjwxw\" (UniqueName: \"kubernetes.io/projected/364c8073-052c-488d-ba47-72bd1eeb97ab-kube-api-access-fjwxw\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.415479 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7caf090-1cf9-453a-abd4-abf713ba136c-config-volume\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.415940 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.415763 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:12:52.415940 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.415781 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:12:52.415940 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.415823 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:52.915809713 +0000 UTC m=+35.075737311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:12:52.415940 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415827 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.415940 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415879 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.416240 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415952 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f7caf090-1cf9-453a-abd4-abf713ba136c-config-volume\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.416240 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.415966 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.416240 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.416040 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f7caf090-1cf9-453a-abd4-abf713ba136c-tmp-dir\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.420169 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.420144 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.420273 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.420253 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.420312 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.420274 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/364c8073-052c-488d-ba47-72bd1eeb97ab-cert\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.423867 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.423841 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.424048 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.424027 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjwxw\" (UniqueName: \"kubernetes.io/projected/364c8073-052c-488d-ba47-72bd1eeb97ab-kube-api-access-fjwxw\") pod \"ingress-canary-79gsb\" (UID: \"364c8073-052c-488d-ba47-72bd1eeb97ab\") " pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.424219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.424202 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96rr4\" (UniqueName: \"kubernetes.io/projected/f7caf090-1cf9-453a-abd4-abf713ba136c-kube-api-access-96rr4\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.424317 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.424302 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9462\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.488264 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.488234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerStarted","Data":"6a2765000e212bf9c1e40fcae2dd8d4b99856ba969710fc71ae71ab4a0108213"} Aug 05 17:12:52.534785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.534765 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-79gsb" Aug 05 17:12:52.661011 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.660766 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-79gsb"] Aug 05 17:12:52.664556 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:12:52.664521 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364c8073_052c_488d_ba47_72bd1eeb97ab.slice/crio-58a21332c8b81033ba9296108ce58d0d2ab3d173029612379aa3fd17b05f2b2c WatchSource:0}: Error finding container 58a21332c8b81033ba9296108ce58d0d2ab3d173029612379aa3fd17b05f2b2c: Status 404 returned error can't find the container with id 58a21332c8b81033ba9296108ce58d0d2ab3d173029612379aa3fd17b05f2b2c Aug 05 17:12:52.774881 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.774847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:52.919337 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.919252 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:52.919337 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.919297 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:52.919490 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.919410 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:12:52.919490 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.919453 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:12:52.919490 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.919466 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:12:52.919490 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.919472 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:12:53.919456745 +0000 UTC m=+36.079384315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:12:52.919610 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:52.919503 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:53.919492846 +0000 UTC m=+36.079420416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:12:52.956472 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:52.956441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:53.493928 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:53.493894 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="6a2765000e212bf9c1e40fcae2dd8d4b99856ba969710fc71ae71ab4a0108213" exitCode=0 Aug 05 17:12:53.494517 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:53.493970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"6a2765000e212bf9c1e40fcae2dd8d4b99856ba969710fc71ae71ab4a0108213"} Aug 05 17:12:53.495360 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:53.495338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-79gsb" event={"ID":"364c8073-052c-488d-ba47-72bd1eeb97ab","Type":"ContainerStarted","Data":"58a21332c8b81033ba9296108ce58d0d2ab3d173029612379aa3fd17b05f2b2c"} Aug 05 17:12:53.927029 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:53.926945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:53.927029 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:53.926993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:53.927230 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:53.927105 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:12:53.927230 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:53.927181 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:12:55.927162111 +0000 UTC m=+38.087089695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:12:53.927230 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:53.927108 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:12:53.927230 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:53.927219 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:12:53.927437 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:53.927272 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:55.927257464 +0000 UTC m=+38.087185048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:12:54.047470 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.047434 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:54.165885 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.165855 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:54.304367 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.304273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:54.451919 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.451886 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:54.501274 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.501226 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef88c51e-70ff-4dbc-83d4-e7acf95501e4" containerID="0474bee782548728e6c2b69bd930cfe129ae8818f27ff6fc3afcb8f39ff6ebc9" exitCode=0 Aug 05 17:12:54.501741 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.501287 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerDied","Data":"0474bee782548728e6c2b69bd930cfe129ae8818f27ff6fc3afcb8f39ff6ebc9"} Aug 05 17:12:54.886831 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.886796 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:54.983044 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:54.983018 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.137982 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.137751 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.250496 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.250469 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.506555 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.506467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prjht" event={"ID":"ef88c51e-70ff-4dbc-83d4-e7acf95501e4","Type":"ContainerStarted","Data":"30b110feef8a44133ec3c1a984e25af02b97006c25ec51e1d9ab6f47f2347923"} Aug 05 17:12:55.507914 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.507892 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-79gsb" event={"ID":"364c8073-052c-488d-ba47-72bd1eeb97ab","Type":"ContainerStarted","Data":"85810212b5d90722ed3e20e30f6941059a5f64a524c54755a6826a59e6f77122"} Aug 05 17:12:55.524726 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.524700 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.534879 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.534841 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-prjht" podStartSLOduration=7.550414617 podStartE2EDuration="37.534828532s" totalImagesPullingTime="29.984413915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:55.534741193 +0000 UTC m=+37.694668784" watchObservedRunningTime="2026-08-05 17:12:55.534828532 +0000 UTC m=+37.694756125" Aug 05 17:12:55.551046 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.551005 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-79gsb" podStartSLOduration=1.053265309 podStartE2EDuration="3.550992066s" totalImagesPullingTime="2.497726757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:12:55.550466172 +0000 UTC m=+37.710393763" watchObservedRunningTime="2026-08-05 17:12:55.550992066 +0000 UTC m=+37.710919656" Aug 05 17:12:55.652967 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.652934 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.904140 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.904060 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:55.943466 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.943439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:55.943616 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:55.943474 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:55.943616 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:55.943570 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:12:55.943616 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:55.943581 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:12:55.943721 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:55.943623 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:12:59.943609346 +0000 UTC m=+42.103536945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:12:55.943721 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:55.943571 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:12:55.943721 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:55.943703 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:12:59.943691274 +0000 UTC m=+42.103618858 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:12:56.308105 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:56.308029 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:56.408771 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:56.408737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:56.728799 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:56.728723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:56.832421 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:56.832390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:57.358976 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:57.358935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:57.465321 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:57.465294 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:12:59.978754 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:59.978718 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:12:59.978754 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:12:59.978760 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:12:59.979199 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:59.978865 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:12:59.979199 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:59.978879 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:12:59.979199 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:59.978933 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:07.978920029 +0000 UTC m=+50.138847598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:12:59.979199 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:59.978865 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:12:59.979199 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:12:59.979000 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:13:07.978985462 +0000 UTC m=+50.138913031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:13:06.786404 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:06.786369 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:06.852800 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:06.852770 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:08.038130 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:08.038088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:13:08.038130 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:08.038134 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:13:08.038552 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:08.038233 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:08.038552 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:08.038299 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:13:24.038283745 +0000 UTC m=+66.198211315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:13:08.038552 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:08.038235 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:13:08.038552 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:08.038334 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:13:08.038552 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:08.038376 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:24.038365626 +0000 UTC m=+66.198293195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:13:08.836989 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:08.836955 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:08.902515 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:08.902484 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:09.862401 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:09.862371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:09.929135 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:09.929103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:10.322653 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:10.322610 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:10.401966 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:10.401932 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:16.436287 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:16.436254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:16.556918 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:16.556887 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:16.644689 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:16.644659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:17.412580 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:17.412547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:17.488202 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:17.488175 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rd856" Aug 05 17:13:17.515838 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:17.515800 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:17.768586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:17.768502 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:17.864848 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:17.864814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:24.060302 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.060262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:13:24.060302 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.060312 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:13:24.060811 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.060411 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:13:24.060811 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.060416 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:24.060811 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.060493 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:13:56.060471801 +0000 UTC m=+98.220399387 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:13:24.060811 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.060425 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:13:24.060811 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.060583 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:13:56.060566249 +0000 UTC m=+98.220493836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:13:24.161237 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.161203 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:13:24.161415 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.161261 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:13:24.164838 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.164820 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 05 17:13:24.164893 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.164823 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 05 17:13:24.172280 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.172255 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:13:24.172379 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:24.172315 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:28.172297305 +0000 UTC m=+130.332224877 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : secret "metrics-daemon-secret" not found Aug 05 17:13:24.176381 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.176361 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9678ee84-e4aa-4eae-bdbf-9e294941d737-original-pull-secret\") pod \"global-pull-secret-syncer-njb6v\" (UID: \"9678ee84-e4aa-4eae-bdbf-9e294941d737\") " pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:13:24.261756 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.261717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:13:24.265111 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.265094 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 05 17:13:24.274973 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.274950 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 05 17:13:24.285488 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.285463 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9ct8\" (UniqueName: \"kubernetes.io/projected/d6cae1ea-352a-4289-9337-210a0a10178d-kube-api-access-r9ct8\") pod \"network-check-target-wxz44\" (UID: \"d6cae1ea-352a-4289-9337-210a0a10178d\") " pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:13:24.430185 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.430155 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g8bnx\"" Aug 05 17:13:24.437511 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.436064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:24.438033 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.438018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:13:24.442261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.442247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-njb6v" Aug 05 17:13:24.606092 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.606063 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wxz44"] Aug 05 17:13:24.608943 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:13:24.608919 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cae1ea_352a_4289_9337_210a0a10178d.slice/crio-40cc676d042cb004a71f25a8b9e090357e26c08851357e25c7db2dbd6758f041 WatchSource:0}: Error finding container 40cc676d042cb004a71f25a8b9e090357e26c08851357e25c7db2dbd6758f041: Status 404 returned error can't find the container with id 40cc676d042cb004a71f25a8b9e090357e26c08851357e25c7db2dbd6758f041 Aug 05 17:13:24.613132 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:24.613106 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-njb6v"] Aug 05 17:13:24.615970 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:13:24.615942 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9678ee84_e4aa_4eae_bdbf_9e294941d737.slice/crio-ef4b772087c740affb34ba0ab2c36a6e38e949470d5600e9702251606c2e5743 WatchSource:0}: Error finding container ef4b772087c740affb34ba0ab2c36a6e38e949470d5600e9702251606c2e5743: Status 404 returned error can't find the container with id ef4b772087c740affb34ba0ab2c36a6e38e949470d5600e9702251606c2e5743 Aug 05 17:13:25.577656 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:25.577570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxz44" event={"ID":"d6cae1ea-352a-4289-9337-210a0a10178d","Type":"ContainerStarted","Data":"40cc676d042cb004a71f25a8b9e090357e26c08851357e25c7db2dbd6758f041"} Aug 05 17:13:25.579026 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:25.578974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njb6v" event={"ID":"9678ee84-e4aa-4eae-bdbf-9e294941d737","Type":"ContainerStarted","Data":"ef4b772087c740affb34ba0ab2c36a6e38e949470d5600e9702251606c2e5743"} Aug 05 17:13:28.189646 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:28.189607 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:28.293483 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:28.293449 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:29.590329 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.590285 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-njb6v" event={"ID":"9678ee84-e4aa-4eae-bdbf-9e294941d737","Type":"ContainerStarted","Data":"ac77324841d158cbbc193a11ad148d18e1d0e948cabec1e024fe5f689dce49b2"} Aug 05 17:13:29.591686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.591662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wxz44" event={"ID":"d6cae1ea-352a-4289-9337-210a0a10178d","Type":"ContainerStarted","Data":"73b3159e95959a7e6b774f67ba4cb855e38194c7e18090d75bcdca882eac5be8"} Aug 05 17:13:29.591786 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.591774 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:13:29.607965 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.607922 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-njb6v" podStartSLOduration=67.340420076 podStartE2EDuration="1m11.607909125s" totalImagesPullingTime="4.267489049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:29.607586858 +0000 UTC m=+71.767514449" watchObservedRunningTime="2026-08-05 17:13:29.607909125 +0000 UTC m=+71.767836743" Aug 05 17:13:29.626003 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.625956 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wxz44" podStartSLOduration=67.354601328 podStartE2EDuration="1m11.625941212s" totalImagesPullingTime="4.271339884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:13:29.62514769 +0000 UTC m=+71.785075279" watchObservedRunningTime="2026-08-05 17:13:29.625941212 +0000 UTC m=+71.785868781" Aug 05 17:13:29.854938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.854850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:29.984030 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:29.983995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:30.085240 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:30.085213 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:32.336942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:32.336907 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:32.438114 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:32.438075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:32.564964 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:32.564941 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:32.677140 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:32.677115 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:32.774262 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:32.774235 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:54.439310 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:54.439194 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:54.512095 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:54.512053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:13:56.090760 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:56.090727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:13:56.090767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:56.090875 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:56.090875 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:56.090954 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls podName:f7caf090-1cf9-453a-abd4-abf713ba136c nodeName:}" failed. No retries permitted until 2026-08-05 17:15:00.090937419 +0000 UTC m=+162.250865013 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls") pod "dns-default-lm8mt" (UID: "f7caf090-1cf9-453a-abd4-abf713ba136c") : secret "dns-default-metrics-tls" not found Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:56.090886 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-dbf54dff7-lsfdk: secret "image-registry-tls" not found Aug 05 17:13:56.091126 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:13:56.091019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls podName:1bf11b46-f3d6-4d6e-96e7-e363a1ffb158 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:00.091006246 +0000 UTC m=+162.250933816 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls") pod "image-registry-dbf54dff7-lsfdk" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158") : secret "image-registry-tls" not found Aug 05 17:14:00.596525 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:00.596495 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wxz44" Aug 05 17:14:18.148650 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:18.148608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:19.945320 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:19.945246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:28.207213 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:28.207171 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:14:28.207629 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:28.207318 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Aug 05 17:14:28.207629 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:28.207383 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs podName:da13f392-8652-4de4-a260-9fb0c690bf43 nodeName:}" failed. No retries permitted until 2026-08-05 17:16:30.207367615 +0000 UTC m=+252.367295185 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs") pod "network-metrics-daemon-lps6b" (UID: "da13f392-8652-4de4-a260-9fb0c690bf43") : secret "metrics-daemon-secret" not found Aug 05 17:14:42.701519 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.701484 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv"] Aug 05 17:14:42.703231 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.703216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.705380 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.705357 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-svfhd"] Aug 05 17:14:42.705812 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.705788 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.705910 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.705831 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4ttcb\"" Aug 05 17:14:42.706087 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.706066 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Aug 05 17:14:42.706087 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.706077 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Aug 05 17:14:42.706228 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.706182 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.706974 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.706957 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d966c8946-tf75k"] Aug 05 17:14:42.707078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.707064 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.708707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.708689 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.709246 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.709228 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4s5mm\"" Aug 05 17:14:42.709774 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.709758 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.709853 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.709788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Aug 05 17:14:42.710366 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.710329 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.710586 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.710570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Aug 05 17:14:42.711438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.711422 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mbbnw\"" Aug 05 17:14:42.711553 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.711539 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Aug 05 17:14:42.712140 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.712118 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Aug 05 17:14:42.712226 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.712148 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.712226 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.712185 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Aug 05 17:14:42.712402 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.712380 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Aug 05 17:14:42.712598 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.712581 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.721028 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.721003 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Aug 05 17:14:42.721261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.721184 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv"] Aug 05 17:14:42.723798 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.723753 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-svfhd"] Aug 05 17:14:42.724809 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.724745 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d966c8946-tf75k"] Aug 05 17:14:42.814078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgjnn\" (UniqueName: \"kubernetes.io/projected/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-kube-api-access-cgjnn\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.814078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814079 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.814291 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814098 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-default-certificate\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.814291 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814181 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-trusted-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814291 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814213 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-config\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.814291 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2h74\" (UniqueName: \"kubernetes.io/projected/82b231cc-138d-4c1f-9d33-769d16907f7e-kube-api-access-c2h74\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-service-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8df2\" (UniqueName: \"kubernetes.io/projected/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-kube-api-access-s8df2\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.814413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-snapshots\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82b231cc-138d-4c1f-9d33-769d16907f7e-serving-cert\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814392 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-serving-cert\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.814596 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-tmp\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.814596 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814473 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-stats-auth\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.814596 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.814510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.827022 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.826998 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5"] Aug 05 17:14:42.828758 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.828744 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9"] Aug 05 17:14:42.828874 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.828857 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:42.830469 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.830452 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:42.832389 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832371 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Aug 05 17:14:42.832592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832565 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.832686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832397 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Aug 05 17:14:42.832686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832420 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zbdxd\"" Aug 05 17:14:42.832686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832411 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.832853 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.832471 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.833057 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.833042 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.833110 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.833096 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-p8d7s\"" Aug 05 17:14:42.833149 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.833105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Aug 05 17:14:42.846960 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.846939 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5"] Aug 05 17:14:42.856379 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.856357 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9"] Aug 05 17:14:42.915023 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.914988 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-serving-cert\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.915023 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915028 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-tmp\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-stats-auth\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915076 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915108 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915154 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgjnn\" (UniqueName: \"kubernetes.io/projected/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-kube-api-access-cgjnn\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915175 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915200 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-default-certificate\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915226 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhmmj\" (UniqueName: \"kubernetes.io/projected/4b686f12-35df-4873-9087-f541b054999e-kube-api-access-nhmmj\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:42.915346 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:42.915408 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:42.915414 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.415393457 +0000 UTC m=+145.575321038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : secret "router-metrics-certs-default" not found Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:42.915463 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.415443858 +0000 UTC m=+145.575371432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-trusted-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915519 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-config\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915551 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-tmp\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2h74\" (UniqueName: \"kubernetes.io/projected/82b231cc-138d-4c1f-9d33-769d16907f7e-kube-api-access-c2h74\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gst\" (UniqueName: \"kubernetes.io/projected/c82f7016-607a-4d26-8fd7-21544c402ed5-kube-api-access-d9gst\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-service-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8df2\" (UniqueName: \"kubernetes.io/projected/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-kube-api-access-s8df2\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82f7016-607a-4d26-8fd7-21544c402ed5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82f7016-607a-4d26-8fd7-21544c402ed5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-snapshots\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.915877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.915861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82b231cc-138d-4c1f-9d33-769d16907f7e-serving-cert\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.916449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.916319 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-config\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.916506 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.916478 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-service-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.916591 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.916567 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82b231cc-138d-4c1f-9d33-769d16907f7e-trusted-ca-bundle\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.916677 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.916651 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/82b231cc-138d-4c1f-9d33-769d16907f7e-snapshots\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.917611 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.917586 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-serving-cert\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.918221 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.918200 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82b231cc-138d-4c1f-9d33-769d16907f7e-serving-cert\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.918298 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.918228 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-stats-auth\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.918396 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.918381 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-default-certificate\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.919757 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.919734 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:42.927379 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.927356 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8df2\" (UniqueName: \"kubernetes.io/projected/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-kube-api-access-s8df2\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:42.929530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.929507 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2h74\" (UniqueName: \"kubernetes.io/projected/82b231cc-138d-4c1f-9d33-769d16907f7e-kube-api-access-c2h74\") pod \"insights-operator-77696685b-svfhd\" (UID: \"82b231cc-138d-4c1f-9d33-769d16907f7e\") " pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:42.929674 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.929657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgjnn\" (UniqueName: \"kubernetes.io/projected/ef7a1c65-14e9-4fbd-870e-6d7d40773a2d-kube-api-access-cgjnn\") pod \"service-ca-operator-784f97bcf6-7zrvv\" (UID: \"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:42.954158 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.954085 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-vvxlc"] Aug 05 17:14:42.957267 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.957251 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:42.961174 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.961153 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Aug 05 17:14:42.961268 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.961237 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Aug 05 17:14:42.961728 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.961709 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Aug 05 17:14:42.961848 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.961788 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qh9t4\"" Aug 05 17:14:42.965983 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.965942 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Aug 05 17:14:42.966216 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.966201 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Aug 05 17:14:42.982925 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:42.982903 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-vvxlc"] Aug 05 17:14:43.013400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.013361 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" Aug 05 17:14:43.016649 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.016617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82f7016-607a-4d26-8fd7-21544c402ed5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.016748 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.016728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-trusted-ca\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.016814 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.016799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:43.016873 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.016835 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8jd4\" (UniqueName: \"kubernetes.io/projected/62a008db-636a-4cc2-a080-55a194c06ba9-kube-api-access-x8jd4\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.016922 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.016905 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:43.016977 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.016966 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls podName:4b686f12-35df-4873-9087-f541b054999e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:43.516953319 +0000 UTC m=+145.676880888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-dvsk9" (UID: "4b686f12-35df-4873-9087-f541b054999e") : secret "samples-operator-tls" not found Aug 05 17:14:43.017026 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.016997 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhmmj\" (UniqueName: \"kubernetes.io/projected/4b686f12-35df-4873-9087-f541b054999e-kube-api-access-nhmmj\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:43.017071 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.017025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-config\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.017121 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.017108 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c82f7016-607a-4d26-8fd7-21544c402ed5-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.017186 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.017167 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gst\" (UniqueName: \"kubernetes.io/projected/c82f7016-607a-4d26-8fd7-21544c402ed5-kube-api-access-d9gst\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.017246 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.017225 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82f7016-607a-4d26-8fd7-21544c402ed5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.017300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.017255 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62a008db-636a-4cc2-a080-55a194c06ba9-serving-cert\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.019249 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.019231 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c82f7016-607a-4d26-8fd7-21544c402ed5-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.021330 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.021311 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-svfhd" Aug 05 17:14:43.032165 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.032111 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gst\" (UniqueName: \"kubernetes.io/projected/c82f7016-607a-4d26-8fd7-21544c402ed5-kube-api-access-d9gst\") pod \"kube-storage-version-migrator-operator-7878f4b88c-zbvs5\" (UID: \"c82f7016-607a-4d26-8fd7-21544c402ed5\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.033649 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.033610 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhmmj\" (UniqueName: \"kubernetes.io/projected/4b686f12-35df-4873-9087-f541b054999e-kube-api-access-nhmmj\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:43.047218 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.047181 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:43.118300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.118257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8jd4\" (UniqueName: \"kubernetes.io/projected/62a008db-636a-4cc2-a080-55a194c06ba9-kube-api-access-x8jd4\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.118300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.118329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-config\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.118578 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.118509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62a008db-636a-4cc2-a080-55a194c06ba9-serving-cert\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.118578 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.118546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-trusted-ca\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.119217 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.119189 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-config\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.119369 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.119340 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/62a008db-636a-4cc2-a080-55a194c06ba9-trusted-ca\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.121041 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.121006 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/62a008db-636a-4cc2-a080-55a194c06ba9-serving-cert\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.129914 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.129856 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8jd4\" (UniqueName: \"kubernetes.io/projected/62a008db-636a-4cc2-a080-55a194c06ba9-kube-api-access-x8jd4\") pod \"console-operator-5ccd6b445f-vvxlc\" (UID: \"62a008db-636a-4cc2-a080-55a194c06ba9\") " pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.138513 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.138490 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" Aug 05 17:14:43.159008 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.158979 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv"] Aug 05 17:14:43.162123 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:43.162092 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef7a1c65_14e9_4fbd_870e_6d7d40773a2d.slice/crio-4cb4964fc68f52358cb554063b206382d444fa1283bab33b0b671a228c8e16b9 WatchSource:0}: Error finding container 4cb4964fc68f52358cb554063b206382d444fa1283bab33b0b671a228c8e16b9: Status 404 returned error can't find the container with id 4cb4964fc68f52358cb554063b206382d444fa1283bab33b0b671a228c8e16b9 Aug 05 17:14:43.177929 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.177899 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-svfhd"] Aug 05 17:14:43.180366 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:43.180343 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b231cc_138d_4c1f_9d33_769d16907f7e.slice/crio-da49d5ab66a836217ba87a6d5b94d12708e5aa673006509e6968edd9280f96bc WatchSource:0}: Error finding container da49d5ab66a836217ba87a6d5b94d12708e5aa673006509e6968edd9280f96bc: Status 404 returned error can't find the container with id da49d5ab66a836217ba87a6d5b94d12708e5aa673006509e6968edd9280f96bc Aug 05 17:14:43.266585 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.266550 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:43.269058 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.269035 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5"] Aug 05 17:14:43.273017 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:43.272993 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82f7016_607a_4d26_8fd7_21544c402ed5.slice/crio-6ab7f464ae7c5b006db6297781da2ba51ec6aabd77714be5d69d54e6b2b2eb85 WatchSource:0}: Error finding container 6ab7f464ae7c5b006db6297781da2ba51ec6aabd77714be5d69d54e6b2b2eb85: Status 404 returned error can't find the container with id 6ab7f464ae7c5b006db6297781da2ba51ec6aabd77714be5d69d54e6b2b2eb85 Aug 05 17:14:43.397259 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.395135 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-vvxlc"] Aug 05 17:14:43.400159 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:43.400132 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a008db_636a_4cc2_a080_55a194c06ba9.slice/crio-2f849d4a558cb33386a87ee92b52f0d6cc1433ee691e34837fc0d4819c3af433 WatchSource:0}: Error finding container 2f849d4a558cb33386a87ee92b52f0d6cc1433ee691e34837fc0d4819c3af433: Status 404 returned error can't find the container with id 2f849d4a558cb33386a87ee92b52f0d6cc1433ee691e34837fc0d4819c3af433 Aug 05 17:14:43.421674 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.421627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:43.421789 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.421708 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:43.421789 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.421752 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:43.421885 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.421813 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:44.421797602 +0000 UTC m=+146.581725190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : secret "router-metrics-certs-default" not found Aug 05 17:14:43.421885 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.421833 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:44.421821918 +0000 UTC m=+146.581749503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:43.522116 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.522022 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:43.522264 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.522169 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:43.522264 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:43.522235 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls podName:4b686f12-35df-4873-9087-f541b054999e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:44.522219843 +0000 UTC m=+146.682147412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-dvsk9" (UID: "4b686f12-35df-4873-9087-f541b054999e") : secret "samples-operator-tls" not found Aug 05 17:14:43.761478 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.761439 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" event={"ID":"62a008db-636a-4cc2-a080-55a194c06ba9","Type":"ContainerStarted","Data":"2f849d4a558cb33386a87ee92b52f0d6cc1433ee691e34837fc0d4819c3af433"} Aug 05 17:14:43.762697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.762662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" event={"ID":"c82f7016-607a-4d26-8fd7-21544c402ed5","Type":"ContainerStarted","Data":"6ab7f464ae7c5b006db6297781da2ba51ec6aabd77714be5d69d54e6b2b2eb85"} Aug 05 17:14:43.763789 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.763764 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" event={"ID":"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d","Type":"ContainerStarted","Data":"4cb4964fc68f52358cb554063b206382d444fa1283bab33b0b671a228c8e16b9"} Aug 05 17:14:43.764787 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:43.764760 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-svfhd" event={"ID":"82b231cc-138d-4c1f-9d33-769d16907f7e","Type":"ContainerStarted","Data":"da49d5ab66a836217ba87a6d5b94d12708e5aa673006509e6968edd9280f96bc"} Aug 05 17:14:44.431144 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:44.431102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:44.431351 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:44.431189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:44.431417 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:44.431396 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:46.431375759 +0000 UTC m=+148.591303551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:44.431745 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:44.431713 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:44.431830 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:44.431788 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:46.431771859 +0000 UTC m=+148.591699442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : secret "router-metrics-certs-default" not found Aug 05 17:14:44.532012 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:44.531963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:44.532205 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:44.532134 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:44.532266 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:44.532214 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls podName:4b686f12-35df-4873-9087-f541b054999e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:46.532192961 +0000 UTC m=+148.692120531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-dvsk9" (UID: "4b686f12-35df-4873-9087-f541b054999e") : secret "samples-operator-tls" not found Aug 05 17:14:45.035135 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:45.035086 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:45.130594 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:45.130558 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:46.449411 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.449367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:46.449879 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.449460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:46.449879 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:46.449500 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:46.449879 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:46.449580 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:50.449564016 +0000 UTC m=+152.609491585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : secret "router-metrics-certs-default" not found Aug 05 17:14:46.449879 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:46.449624 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:50.449606776 +0000 UTC m=+152.609534363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:46.549865 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.549832 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:46.549974 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:46.549956 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:46.550033 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:46.550019 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls podName:4b686f12-35df-4873-9087-f541b054999e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:50.549999552 +0000 UTC m=+152.709927156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-dvsk9" (UID: "4b686f12-35df-4873-9087-f541b054999e") : secret "samples-operator-tls" not found Aug 05 17:14:46.777265 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.777235 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/0.log" Aug 05 17:14:46.777441 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.777278 2558 generic.go:356] "Generic (PLEG): container finished" podID="62a008db-636a-4cc2-a080-55a194c06ba9" containerID="8fef6507ed17f55dd9756d9b6909c0a6ff916e86ff7ddad7352b6f65d0fd4399" exitCode=255 Aug 05 17:14:46.777441 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.777336 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" event={"ID":"62a008db-636a-4cc2-a080-55a194c06ba9","Type":"ContainerDied","Data":"8fef6507ed17f55dd9756d9b6909c0a6ff916e86ff7ddad7352b6f65d0fd4399"} Aug 05 17:14:46.777648 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.777621 2558 scope.go:117] "RemoveContainer" containerID="8fef6507ed17f55dd9756d9b6909c0a6ff916e86ff7ddad7352b6f65d0fd4399" Aug 05 17:14:46.778980 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.778934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" event={"ID":"c82f7016-607a-4d26-8fd7-21544c402ed5","Type":"ContainerStarted","Data":"e33f40e83b629d96a76f705524f9b2d61df70bcb63db9b952ab54ef93c62dc63"} Aug 05 17:14:46.780495 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.780459 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" event={"ID":"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d","Type":"ContainerStarted","Data":"ee0435be8bb0f7b802168acf002824d0f22b9701955ef2c65066a1d1a7701421"} Aug 05 17:14:46.781951 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.781931 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-svfhd" event={"ID":"82b231cc-138d-4c1f-9d33-769d16907f7e","Type":"ContainerStarted","Data":"cd53a872140594ade04cc307db1318113d65aae166b4e7869f0489aad55afffa"} Aug 05 17:14:46.838316 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.837934 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" podStartSLOduration=1.454981475 podStartE2EDuration="4.837914178s" totalImagesPullingTime="3.382932703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:46.816300696 +0000 UTC m=+148.976228289" watchObservedRunningTime="2026-08-05 17:14:46.837914178 +0000 UTC m=+148.997841769" Aug 05 17:14:46.838539 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.838507 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-svfhd" podStartSLOduration=1.478559561 podStartE2EDuration="4.838496395s" totalImagesPullingTime="3.359936834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:46.838161606 +0000 UTC m=+148.998089199" watchObservedRunningTime="2026-08-05 17:14:46.838496395 +0000 UTC m=+148.998424044" Aug 05 17:14:46.862095 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:46.862037 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" podStartSLOduration=1.592400228 podStartE2EDuration="4.862018165s" totalImagesPullingTime="3.269617937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:46.861061773 +0000 UTC m=+149.020989367" watchObservedRunningTime="2026-08-05 17:14:46.862018165 +0000 UTC m=+149.021945758" Aug 05 17:14:47.763094 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.763051 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:47.786568 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.786542 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/1.log" Aug 05 17:14:47.786938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.786924 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/0.log" Aug 05 17:14:47.786990 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.786957 2558 generic.go:356] "Generic (PLEG): container finished" podID="62a008db-636a-4cc2-a080-55a194c06ba9" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" exitCode=255 Aug 05 17:14:47.787094 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.787072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" event={"ID":"62a008db-636a-4cc2-a080-55a194c06ba9","Type":"ContainerDied","Data":"af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa"} Aug 05 17:14:47.787183 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.787169 2558 scope.go:117] "RemoveContainer" containerID="8fef6507ed17f55dd9756d9b6909c0a6ff916e86ff7ddad7352b6f65d0fd4399" Aug 05 17:14:47.787393 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.787371 2558 scope.go:117] "RemoveContainer" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" Aug 05 17:14:47.787578 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:47.787556 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:14:47.849826 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.849795 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:47.964025 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:47.963992 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:48.062562 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.062464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:48.153619 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.153584 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hrgfv"] Aug 05 17:14:48.157377 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.157350 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.163115 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.163088 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 05 17:14:48.163115 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.163088 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 05 17:14:48.163791 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.163392 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7l8s7\"" Aug 05 17:14:48.164198 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.164178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:48.174959 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.174932 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrgfv"] Aug 05 17:14:48.264548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.264511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcj78\" (UniqueName: \"kubernetes.io/projected/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-api-access-tcj78\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.264548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.264555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11817afc-64ad-43fc-9bf6-e6552b52f0b8-data-volume\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.264768 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.264662 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11817afc-64ad-43fc-9bf6-e6552b52f0b8-crio-socket\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.264768 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.264717 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.264768 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.264761 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365766 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365680 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11817afc-64ad-43fc-9bf6-e6552b52f0b8-data-volume\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365766 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11817afc-64ad-43fc-9bf6-e6552b52f0b8-crio-socket\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365956 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365956 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365855 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365956 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365870 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11817afc-64ad-43fc-9bf6-e6552b52f0b8-crio-socket\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.365956 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.365935 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcj78\" (UniqueName: \"kubernetes.io/projected/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-api-access-tcj78\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.366171 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.365941 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:48.366171 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.365977 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.366171 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.366059 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11817afc-64ad-43fc-9bf6-e6552b52f0b8-data-volume\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.366171 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.366024 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:48.866010478 +0000 UTC m=+151.025938074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : configmap "kube-rbac-proxy" not found Aug 05 17:14:48.366171 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.366107 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:48.866087692 +0000 UTC m=+151.026015265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.379756 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.379736 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcj78\" (UniqueName: \"kubernetes.io/projected/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-api-access-tcj78\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.512923 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.512885 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:48.585953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.585922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:48.794908 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.794882 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/1.log" Aug 05 17:14:48.795308 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.795212 2558 scope.go:117] "RemoveContainer" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" Aug 05 17:14:48.795449 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.795418 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:14:48.870316 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.870280 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.870503 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:48.870353 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:48.870503 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.870353 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:48.870503 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.870489 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:48.870624 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.870520 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:49.870497423 +0000 UTC m=+152.030424995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : configmap "kube-rbac-proxy" not found Aug 05 17:14:48.870624 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:48.870567 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:49.870545098 +0000 UTC m=+152.030472742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:49.878517 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:49.878481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:49.878966 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:49.878524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:49.878966 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:49.878613 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:49.878966 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:49.878669 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:49.878966 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:49.878720 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:51.878699309 +0000 UTC m=+154.038626878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : configmap "kube-rbac-proxy" not found Aug 05 17:14:49.878966 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:49.878737 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:51.878729221 +0000 UTC m=+154.038656791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:50.045809 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.045777 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:50.073544 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.073516 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xhjp4"] Aug 05 17:14:50.076734 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.076717 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.079495 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.079474 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Aug 05 17:14:50.079768 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.079750 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Aug 05 17:14:50.080035 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.080019 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Aug 05 17:14:50.080928 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.080906 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Aug 05 17:14:50.081032 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.080918 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xsgwm\"" Aug 05 17:14:50.085914 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.085896 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xhjp4"] Aug 05 17:14:50.180091 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.180064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-key\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.180239 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.180096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mfg\" (UniqueName: \"kubernetes.io/projected/f3243d08-6dda-4aa7-931b-161b3ef11ac4-kube-api-access-z6mfg\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.180239 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.180122 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-cabundle\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.281288 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.281253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-key\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.281460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.281291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mfg\" (UniqueName: \"kubernetes.io/projected/f3243d08-6dda-4aa7-931b-161b3ef11ac4-kube-api-access-z6mfg\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.281460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.281411 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-cabundle\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.282011 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.281990 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-cabundle\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.283510 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.283489 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f3243d08-6dda-4aa7-931b-161b3ef11ac4-signing-key\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.293193 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.293167 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mfg\" (UniqueName: \"kubernetes.io/projected/f3243d08-6dda-4aa7-931b-161b3ef11ac4-kube-api-access-z6mfg\") pod \"service-ca-98c88fbb5-xhjp4\" (UID: \"f3243d08-6dda-4aa7-931b-161b3ef11ac4\") " pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.385742 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.385715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" Aug 05 17:14:50.482391 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.482352 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:50.482532 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.482427 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:50.482532 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:50.482499 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Aug 05 17:14:50.482657 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:50.482617 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:58.482595797 +0000 UTC m=+160.642523381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : configmap references non-existent config key: service-ca.crt Aug 05 17:14:50.482725 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:50.482668 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs podName:ecdd68f3-c841-4fdb-b6a2-adbd342849fb nodeName:}" failed. No retries permitted until 2026-08-05 17:14:58.48265055 +0000 UTC m=+160.642578134 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs") pod "router-default-6d966c8946-tf75k" (UID: "ecdd68f3-c841-4fdb-b6a2-adbd342849fb") : secret "router-metrics-certs-default" not found Aug 05 17:14:50.513472 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.513444 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-xhjp4"] Aug 05 17:14:50.516060 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:50.516037 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3243d08_6dda_4aa7_931b_161b3ef11ac4.slice/crio-45cc978661911a1d056a1fadd8ff01eef4ba87350f9565fafbf6130fef53f47f WatchSource:0}: Error finding container 45cc978661911a1d056a1fadd8ff01eef4ba87350f9565fafbf6130fef53f47f: Status 404 returned error can't find the container with id 45cc978661911a1d056a1fadd8ff01eef4ba87350f9565fafbf6130fef53f47f Aug 05 17:14:50.542210 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.542187 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:50.583468 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.583446 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:50.583593 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:50.583577 2558 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Aug 05 17:14:50.583691 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:50.583628 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls podName:4b686f12-35df-4873-9087-f541b054999e nodeName:}" failed. No retries permitted until 2026-08-05 17:14:58.583612506 +0000 UTC m=+160.743540075 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls") pod "cluster-samples-operator-559cbf5745-dvsk9" (UID: "4b686f12-35df-4873-9087-f541b054999e") : secret "samples-operator-tls" not found Aug 05 17:14:50.640397 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.640371 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:50.675708 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.675686 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6fj4_27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83/dns-node-resolver/0.log" Aug 05 17:14:50.801795 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.801711 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" event={"ID":"f3243d08-6dda-4aa7-931b-161b3ef11ac4","Type":"ContainerStarted","Data":"cf80bdf7ba074460ce8af4f46c1b78a336e7882c2ab868f336ebe211a0a9d9e5"} Aug 05 17:14:50.801795 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:50.801769 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" event={"ID":"f3243d08-6dda-4aa7-931b-161b3ef11ac4","Type":"ContainerStarted","Data":"45cc978661911a1d056a1fadd8ff01eef4ba87350f9565fafbf6130fef53f47f"} Aug 05 17:14:51.403891 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:51.403859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:51.893773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:51.893744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:51.893935 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:51.893781 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:51.893935 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:51.893839 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:51.893935 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:51.893909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:55.893891666 +0000 UTC m=+158.053819253 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : configmap "kube-rbac-proxy" not found Aug 05 17:14:51.894115 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:51.893940 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:51.894115 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:51.894007 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:14:55.893988598 +0000 UTC m=+158.053916184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:52.086502 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.086471 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcnpm_d65e80cc-6d3d-4b57-9489-dec130c43c54/node-ca/0.log" Aug 05 17:14:52.205165 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.205071 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:52.314664 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.314589 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:52.468119 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.468035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:52.480173 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.480152 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-79gsb_364c8073-052c-488d-ba47-72bd1eeb97ab/serve-healthcheck-canary/0.log" Aug 05 17:14:52.584680 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.584623 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:52.679870 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.679826 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:52.901324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:52.901292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:53.082742 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.082711 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:53.266888 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.266803 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:53.266888 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.266888 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:14:53.267217 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.267204 2558 scope.go:117] "RemoveContainer" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" Aug 05 17:14:53.267378 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:53.267358 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:14:53.480878 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.480844 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-zbvs5_c82f7016-607a-4d26-8fd7-21544c402ed5/kube-storage-version-migrator-operator/0.log" Aug 05 17:14:53.510893 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.510858 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:53.907249 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:53.907211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:54.165964 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:54.165888 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:54.711303 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:54.711269 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:54.906427 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:54.906392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:55.217815 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.217772 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" Aug 05 17:14:55.226936 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.226912 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lm8mt" podUID="f7caf090-1cf9-453a-abd4-abf713ba136c" Aug 05 17:14:55.333102 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.333065 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lps6b" podUID="da13f392-8652-4de4-a260-9fb0c690bf43" Aug 05 17:14:55.334292 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.334271 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:55.536691 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.536609 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:55.817158 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.817078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:14:55.817158 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.817108 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lm8mt" Aug 05 17:14:55.925950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.925922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:55.929146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.929114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:55.929279 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:55.929179 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:14:55.929503 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.929465 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 05 17:14:55.929571 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.929563 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:03.929535886 +0000 UTC m=+166.089463456 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : secret "insights-runtime-extractor-tls" not found Aug 05 17:14:55.929630 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.929470 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 05 17:14:55.929630 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:14:55.929598 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm podName:11817afc-64ad-43fc-9bf6-e6552b52f0b8 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:03.929587729 +0000 UTC m=+166.089515318 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrgfv" (UID: "11817afc-64ad-43fc-9bf6-e6552b52f0b8") : configmap "kube-rbac-proxy" not found Aug 05 17:14:56.109895 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:56.109823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:56.589749 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:56.589715 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:56.688683 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:56.688651 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:56.939421 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:56.939390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:57.010287 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:57.010259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:57.525038 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:57.525006 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:57.724781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:57.724737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:58.110972 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.110942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:58.322188 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.322152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:58.390055 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.390022 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:58.551604 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.551572 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:58.551773 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.551700 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:58.552173 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.552155 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-service-ca-bundle\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:58.553944 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.553910 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecdd68f3-c841-4fdb-b6a2-adbd342849fb-metrics-certs\") pod \"router-default-6d966c8946-tf75k\" (UID: \"ecdd68f3-c841-4fdb-b6a2-adbd342849fb\") " pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:58.627147 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.627117 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:58.652803 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.652748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:58.654975 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.654948 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b686f12-35df-4873-9087-f541b054999e-samples-operator-tls\") pod \"cluster-samples-operator-559cbf5745-dvsk9\" (UID: \"4b686f12-35df-4873-9087-f541b054999e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:58.743202 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.743176 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" Aug 05 17:14:58.755092 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.755019 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-xhjp4" podStartSLOduration=8.754997871 podStartE2EDuration="8.754997871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:50.857048533 +0000 UTC m=+153.016976125" watchObservedRunningTime="2026-08-05 17:14:58.754997871 +0000 UTC m=+160.914925500" Aug 05 17:14:58.755619 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.755494 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d966c8946-tf75k"] Aug 05 17:14:58.757579 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:14:58.757557 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecdd68f3_c841_4fdb_b6a2_adbd342849fb.slice/crio-6a09d64024b929b891eac1d5f39ffa976cd7fa91a89b6f34a6f3c7d7e50ad7aa WatchSource:0}: Error finding container 6a09d64024b929b891eac1d5f39ffa976cd7fa91a89b6f34a6f3c7d7e50ad7aa: Status 404 returned error can't find the container with id 6a09d64024b929b891eac1d5f39ffa976cd7fa91a89b6f34a6f3c7d7e50ad7aa Aug 05 17:14:58.829120 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.829034 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d966c8946-tf75k" event={"ID":"ecdd68f3-c841-4fdb-b6a2-adbd342849fb","Type":"ContainerStarted","Data":"455ea24c6e9a1dde51f3fd65a5560f8649dad23eb706bd3ece1bec9eb65702ee"} Aug 05 17:14:58.829120 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.829079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d966c8946-tf75k" event={"ID":"ecdd68f3-c841-4fdb-b6a2-adbd342849fb","Type":"ContainerStarted","Data":"6a09d64024b929b891eac1d5f39ffa976cd7fa91a89b6f34a6f3c7d7e50ad7aa"} Aug 05 17:14:58.851734 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.851685 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d966c8946-tf75k" podStartSLOduration=16.851668966 podStartE2EDuration="16.851668966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:58.850295533 +0000 UTC m=+161.010223126" watchObservedRunningTime="2026-08-05 17:14:58.851668966 +0000 UTC m=+161.011596556" Aug 05 17:14:58.873296 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.873246 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9"] Aug 05 17:14:58.906615 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:58.906592 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:59.318352 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.318273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:59.627693 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.627605 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:59.630236 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.630213 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:59.704330 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.704293 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:14:59.835660 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.835577 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" event={"ID":"4b686f12-35df-4873-9087-f541b054999e","Type":"ContainerStarted","Data":"2969c2fd1f9e74b36f06ab0200c9a04372ec77af6bb19d5eb59f88ec74b9dd21"} Aug 05 17:14:59.835660 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.835662 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:59.836927 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.836901 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d966c8946-tf75k" Aug 05 17:14:59.902118 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:14:59.902085 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:00.165536 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.165459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:15:00.165536 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.165503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:00.167925 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.167897 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f7caf090-1cf9-453a-abd4-abf713ba136c-metrics-tls\") pod \"dns-default-lm8mt\" (UID: \"f7caf090-1cf9-453a-abd4-abf713ba136c\") " pod="openshift-dns/dns-default-lm8mt" Aug 05 17:15:00.168075 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.168058 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"image-registry-dbf54dff7-lsfdk\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:00.320990 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.320958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jxp5d\"" Aug 05 17:15:00.321394 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.320958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4tv2\"" Aug 05 17:15:00.328488 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.328468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:00.328591 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.328522 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lm8mt" Aug 05 17:15:00.499622 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.499527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:00.690922 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.690844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lm8mt"] Aug 05 17:15:00.693756 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:00.693674 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7caf090_1cf9_453a_abd4_abf713ba136c.slice/crio-af196fa55e07e7ecbb9974c714b4515782f606207c4887e3770ada80d71a059e WatchSource:0}: Error finding container af196fa55e07e7ecbb9974c714b4515782f606207c4887e3770ada80d71a059e: Status 404 returned error can't find the container with id af196fa55e07e7ecbb9974c714b4515782f606207c4887e3770ada80d71a059e Aug 05 17:15:00.708292 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.708265 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:15:00.719796 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:00.719771 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf11b46_f3d6_4d6e_96e7_e363a1ffb158.slice/crio-d136375d5692dcd0d52a72a6907ab5bc29015c35a7fa106b372060f546494659 WatchSource:0}: Error finding container d136375d5692dcd0d52a72a6907ab5bc29015c35a7fa106b372060f546494659: Status 404 returned error can't find the container with id d136375d5692dcd0d52a72a6907ab5bc29015c35a7fa106b372060f546494659 Aug 05 17:15:00.839698 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.839660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" event={"ID":"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158","Type":"ContainerStarted","Data":"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8"} Aug 05 17:15:00.839853 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.839715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" event={"ID":"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158","Type":"ContainerStarted","Data":"d136375d5692dcd0d52a72a6907ab5bc29015c35a7fa106b372060f546494659"} Aug 05 17:15:00.839853 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.839797 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:00.840873 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.840847 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lm8mt" event={"ID":"f7caf090-1cf9-453a-abd4-abf713ba136c","Type":"ContainerStarted","Data":"af196fa55e07e7ecbb9974c714b4515782f606207c4887e3770ada80d71a059e"} Aug 05 17:15:00.842491 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.842467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" event={"ID":"4b686f12-35df-4873-9087-f541b054999e","Type":"ContainerStarted","Data":"58787a2e9ed6c4b99b8e2393f166f7620a1e7fa0c636023dec11afbbd0f90a6b"} Aug 05 17:15:00.842602 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.842505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" event={"ID":"4b686f12-35df-4873-9087-f541b054999e","Type":"ContainerStarted","Data":"ad295d60cfba700816c724fe0da70174a6656ddc20c96ce8bc6669a692ac250b"} Aug 05 17:15:00.865342 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.865302 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" podStartSLOduration=162.86528808 podStartE2EDuration="2m42.86528808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:00.864654104 +0000 UTC m=+163.024581694" watchObservedRunningTime="2026-08-05 17:15:00.86528808 +0000 UTC m=+163.025215692" Aug 05 17:15:00.883570 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:00.883531 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-559cbf5745-dvsk9" podStartSLOduration=17.19315895 podStartE2EDuration="18.883519491s" totalImagesPullingTime="1.690360541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:00.883118265 +0000 UTC m=+163.043045857" watchObservedRunningTime="2026-08-05 17:15:00.883519491 +0000 UTC m=+163.043447081" Aug 05 17:15:01.116554 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:01.116473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:01.207308 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:01.207275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:01.355085 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:01.355053 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:01.774119 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:01.774081 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:01.915913 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:01.915876 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:02.026830 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.026761 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:02.312019 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.311948 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:02.733706 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.733666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:02.850971 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.850935 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lm8mt" event={"ID":"f7caf090-1cf9-453a-abd4-abf713ba136c","Type":"ContainerStarted","Data":"57728fc2d91a34a5166cfc8bc5229d15696a2077b1055e15b07a0c4001e721e6"} Aug 05 17:15:02.851101 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.850980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lm8mt" event={"ID":"f7caf090-1cf9-453a-abd4-abf713ba136c","Type":"ContainerStarted","Data":"f783fb032a41160fb53a33c8c17a35ec2998eed8125b6eb93fb8bf53d1f4c8d2"} Aug 05 17:15:02.851101 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.851022 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lm8mt" Aug 05 17:15:02.875905 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.875858 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lm8mt" podStartSLOduration=129.256037267 podStartE2EDuration="2m10.875843185s" totalImagesPullingTime="1.619805918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:02.874912057 +0000 UTC m=+165.034839639" watchObservedRunningTime="2026-08-05 17:15:02.875843185 +0000 UTC m=+165.035770776" Aug 05 17:15:02.934344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:02.934313 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:03.996520 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:03.996487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:15:03.997004 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:03.996576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:15:03.997128 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:03.997108 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11817afc-64ad-43fc-9bf6-e6552b52f0b8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:15:03.998924 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:03.998906 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11817afc-64ad-43fc-9bf6-e6552b52f0b8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrgfv\" (UID: \"11817afc-64ad-43fc-9bf6-e6552b52f0b8\") " pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:15:04.066060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:04.066031 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrgfv" Aug 05 17:15:04.194516 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:04.194495 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrgfv"] Aug 05 17:15:04.196883 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:04.196856 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11817afc_64ad_43fc_9bf6_e6552b52f0b8.slice/crio-36e02cc46cf0c42fa315b169d63cb2c8d1e6d2006640f8c877ee1222729d8e7b WatchSource:0}: Error finding container 36e02cc46cf0c42fa315b169d63cb2c8d1e6d2006640f8c877ee1222729d8e7b: Status 404 returned error can't find the container with id 36e02cc46cf0c42fa315b169d63cb2c8d1e6d2006640f8c877ee1222729d8e7b Aug 05 17:15:04.858498 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:04.858475 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrgfv" event={"ID":"11817afc-64ad-43fc-9bf6-e6552b52f0b8","Type":"ContainerStarted","Data":"830d92fdff9a17d1d750acafb8bc007dafd9bdc7d163d519a5b1459b477379b5"} Aug 05 17:15:04.858568 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:04.858528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrgfv" event={"ID":"11817afc-64ad-43fc-9bf6-e6552b52f0b8","Type":"ContainerStarted","Data":"36e02cc46cf0c42fa315b169d63cb2c8d1e6d2006640f8c877ee1222729d8e7b"} Aug 05 17:15:05.317053 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.317014 2558 scope.go:117] "RemoveContainer" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" Aug 05 17:15:05.866622 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.866589 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:15:05.867063 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.867043 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/1.log" Aug 05 17:15:05.867175 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.867081 2558 generic.go:356] "Generic (PLEG): container finished" podID="62a008db-636a-4cc2-a080-55a194c06ba9" containerID="0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869" exitCode=255 Aug 05 17:15:05.867226 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.867159 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" event={"ID":"62a008db-636a-4cc2-a080-55a194c06ba9","Type":"ContainerDied","Data":"0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869"} Aug 05 17:15:05.867278 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.867258 2558 scope.go:117] "RemoveContainer" containerID="af9d4d46833597ad0438844a22e5c85ac27012b1b599f56a00ce72095496fdaa" Aug 05 17:15:05.867592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.867576 2558 scope.go:117] "RemoveContainer" containerID="0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869" Aug 05 17:15:05.867815 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:05.867790 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:15:05.869906 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:05.869874 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrgfv" event={"ID":"11817afc-64ad-43fc-9bf6-e6552b52f0b8","Type":"ContainerStarted","Data":"36f01dc715ae2a1f3e38490a45fdb10062ac838e364e757e083e1e933d5e46d2"} Aug 05 17:15:06.875216 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:06.875125 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrgfv" event={"ID":"11817afc-64ad-43fc-9bf6-e6552b52f0b8","Type":"ContainerStarted","Data":"73087bf4a40e256d1ab2bd8f37e3e9eceb26277e4066c17d9297b254bcb02a1a"} Aug 05 17:15:06.876451 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:06.876433 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:15:06.901336 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:06.901272 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hrgfv" podStartSLOduration=16.761131951 podStartE2EDuration="18.901258801s" totalImagesPullingTime="2.14012685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:14:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:06.90030364 +0000 UTC m=+169.060231230" watchObservedRunningTime="2026-08-05 17:15:06.901258801 +0000 UTC m=+169.061186391" Aug 05 17:15:09.317063 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:09.317007 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:15:09.626837 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:09.626753 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:09.903219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:09.903188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:10.011029 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:10.010998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:11.836400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:11.836279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:11.952859 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:11.952823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:12.857081 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:12.857048 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lm8mt" Aug 05 17:15:13.267697 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:13.267660 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:15:13.267872 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:13.267714 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:15:13.267999 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:13.267987 2558 scope.go:117] "RemoveContainer" containerID="0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869" Aug 05 17:15:13.268138 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:13.268121 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:15:17.198924 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.198882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:17.302741 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.302708 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:17.432266 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.432234 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb"] Aug 05 17:15:17.437916 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.437880 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:17.442692 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.442670 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Aug 05 17:15:17.442797 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.442728 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-46sfs\"" Aug 05 17:15:17.447197 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.447171 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb"] Aug 05 17:15:17.482060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.481999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:17.604116 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.604081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dvdvb\" (UID: \"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:17.704477 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:17.704440 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dvdvb\" (UID: \"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:17.704626 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:17.704589 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Aug 05 17:15:17.704693 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:17.704686 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates podName:20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a nodeName:}" failed. No retries permitted until 2026-08-05 17:15:18.204669322 +0000 UTC m=+180.364596904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates") pod "prometheus-operator-admission-webhook-66685ff6d4-dvdvb" (UID: "20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a") : secret "prometheus-operator-admission-webhook-tls" not found Aug 05 17:15:18.209409 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.209374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dvdvb\" (UID: \"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:18.211868 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.211845 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-dvdvb\" (UID: \"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:18.356334 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.356306 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-46sfs\"" Aug 05 17:15:18.362032 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.362015 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:18.485661 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.485562 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb"] Aug 05 17:15:18.488417 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:18.488389 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20f4fdfc_6080_48cd_8b3a_2b0fb5611f0a.slice/crio-4a17b3c884d411198a70ad8e28046bd337fdd81b38eccca92ca75f4669115128 WatchSource:0}: Error finding container 4a17b3c884d411198a70ad8e28046bd337fdd81b38eccca92ca75f4669115128: Status 404 returned error can't find the container with id 4a17b3c884d411198a70ad8e28046bd337fdd81b38eccca92ca75f4669115128 Aug 05 17:15:18.700242 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.700196 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:18.917670 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:18.917624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" event={"ID":"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a","Type":"ContainerStarted","Data":"4a17b3c884d411198a70ad8e28046bd337fdd81b38eccca92ca75f4669115128"} Aug 05 17:15:20.333428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.333272 2558 patch_prober.go:28] interesting pod/image-registry-dbf54dff7-lsfdk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Aug 05 17:15:20.333428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.333343 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Aug 05 17:15:20.925017 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.924982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" event={"ID":"20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a","Type":"ContainerStarted","Data":"ca44010ea93ef5f1d8c449cbe4a27a6f060f3d9cc46700637f5a058acd2ac5cf"} Aug 05 17:15:20.925214 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.925151 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:20.929742 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.929718 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" Aug 05 17:15:20.947444 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:20.947402 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-dvdvb" podStartSLOduration=2.615057894 podStartE2EDuration="3.947391254s" totalImagesPullingTime="1.33233336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:20.946272639 +0000 UTC m=+183.106200230" watchObservedRunningTime="2026-08-05 17:15:20.947391254 +0000 UTC m=+183.107318845" Aug 05 17:15:21.464797 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.464762 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:21.492769 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.492739 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gfttn"] Aug 05 17:15:21.516446 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.516419 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gfttn"] Aug 05 17:15:21.516597 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.516541 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.520292 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.520264 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 05 17:15:21.520880 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.520860 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 05 17:15:21.521436 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.521384 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 05 17:15:21.521436 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.521425 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 05 17:15:21.521578 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.521385 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ndnfq\"" Aug 05 17:15:21.521578 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.521382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 05 17:15:21.540539 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.540517 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:21.637823 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.637787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.637823 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.637829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf464e26-718f-442c-8a05-c65e3d830439-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.638109 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.637942 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwvxf\" (UniqueName: \"kubernetes.io/projected/bf464e26-718f-442c-8a05-c65e3d830439-kube-api-access-gwvxf\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.638109 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.637980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.738368 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.738278 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.738368 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.738327 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf464e26-718f-442c-8a05-c65e3d830439-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.738368 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.738369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvxf\" (UniqueName: \"kubernetes.io/projected/bf464e26-718f-442c-8a05-c65e3d830439-kube-api-access-gwvxf\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.738663 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.738388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.739068 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.739043 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf464e26-718f-442c-8a05-c65e3d830439-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.740808 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.740783 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.740899 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.740885 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/bf464e26-718f-442c-8a05-c65e3d830439-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.748341 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.748318 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvxf\" (UniqueName: \"kubernetes.io/projected/bf464e26-718f-442c-8a05-c65e3d830439-kube-api-access-gwvxf\") pod \"prometheus-operator-758d7cb874-gfttn\" (UID: \"bf464e26-718f-442c-8a05-c65e3d830439\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.826428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.826400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" Aug 05 17:15:21.850225 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.850206 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:21.896347 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.896326 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:21.983946 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:21.983915 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-gfttn"] Aug 05 17:15:21.987425 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:21.987397 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf464e26_718f_442c_8a05_c65e3d830439.slice/crio-80be37c75409c8b525453abe9fd5e71a6fd60b92b2a5d05b3d47c6fc1af178e2 WatchSource:0}: Error finding container 80be37c75409c8b525453abe9fd5e71a6fd60b92b2a5d05b3d47c6fc1af178e2: Status 404 returned error can't find the container with id 80be37c75409c8b525453abe9fd5e71a6fd60b92b2a5d05b3d47c6fc1af178e2 Aug 05 17:15:22.097493 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:22.097459 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:22.215163 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:22.215131 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:22.934072 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:22.934027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" event={"ID":"bf464e26-718f-442c-8a05-c65e3d830439","Type":"ContainerStarted","Data":"80be37c75409c8b525453abe9fd5e71a6fd60b92b2a5d05b3d47c6fc1af178e2"} Aug 05 17:15:24.285766 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.285734 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:24.317558 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.317532 2558 scope.go:117] "RemoveContainer" containerID="0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869" Aug 05 17:15:24.317735 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:24.317713 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-vvxlc_openshift-console-operator(62a008db-636a-4cc2-a080-55a194c06ba9)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podUID="62a008db-636a-4cc2-a080-55a194c06ba9" Aug 05 17:15:24.392479 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.392441 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:24.941906 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.941866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" event={"ID":"bf464e26-718f-442c-8a05-c65e3d830439","Type":"ContainerStarted","Data":"11c53b9a709bad42da1a5ea84b296dd8c8c7edcc4dce9de4fa29d10aef73cb15"} Aug 05 17:15:24.942103 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.941918 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" event={"ID":"bf464e26-718f-442c-8a05-c65e3d830439","Type":"ContainerStarted","Data":"8f9c7bb2d92946ebb9eb73da8ab58dea77dbb2bfccfc24b90f2dfc4f7b782dd6"} Aug 05 17:15:24.962946 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:24.962901 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-gfttn" podStartSLOduration=2.074275676 podStartE2EDuration="3.962886729s" totalImagesPullingTime="1.888611053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:24.961210775 +0000 UTC m=+187.121138365" watchObservedRunningTime="2026-08-05 17:15:24.962886729 +0000 UTC m=+187.122814328" Aug 05 17:15:26.621909 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.621878 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:26.770325 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.770285 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:26.861965 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.861929 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt"] Aug 05 17:15:26.864408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.864388 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:26.868646 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.868613 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-xtq8d\"" Aug 05 17:15:26.868806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.868724 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 05 17:15:26.870058 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.870020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:26.870802 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.870784 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 05 17:15:26.880670 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.880594 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt"] Aug 05 17:15:26.901797 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.901774 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hj8cb"] Aug 05 17:15:26.904453 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.904435 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:26.906899 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.906881 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 05 17:15:26.907185 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.907169 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 05 17:15:26.907248 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.907183 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 05 17:15:26.907465 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.907447 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m5z48\"" Aug 05 17:15:26.983009 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.982972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:26.983172 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.983047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29n9p\" (UniqueName: \"kubernetes.io/projected/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-kube-api-access-29n9p\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:26.983172 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.983092 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:26.983172 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:26.983163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.005198 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.005160 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:27.084605 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.084801 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084743 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-root\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.084801 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084780 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-sys\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.084922 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rsp8\" (UniqueName: \"kubernetes.io/projected/edccba44-31a2-41cc-a7bd-b0f9b9148179-kube-api-access-2rsp8\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.084922 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084851 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29n9p\" (UniqueName: \"kubernetes.io/projected/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-kube-api-access-29n9p\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.084922 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084882 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-textfile\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.084922 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.085121 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084943 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-wtmp\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.085121 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.084971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-tls\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.085121 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:27.084998 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 05 17:15:27.085121 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.085030 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-metrics-client-ca\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.085121 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:27.085060 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls podName:6c111edd-d5be-4cb2-a35d-fa27c1800ab5 nodeName:}" failed. No retries permitted until 2026-08-05 17:15:27.585039533 +0000 UTC m=+189.744967116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-vvhdt" (UID: "6c111edd-d5be-4cb2-a35d-fa27c1800ab5") : secret "openshift-state-metrics-tls" not found Aug 05 17:15:27.085364 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.085144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.085364 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.085215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.085364 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.085245 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.085513 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.085450 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.087542 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.087512 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.099346 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.099319 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29n9p\" (UniqueName: \"kubernetes.io/projected/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-kube-api-access-29n9p\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.185785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-root\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.185785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185788 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-sys\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rsp8\" (UniqueName: \"kubernetes.io/projected/edccba44-31a2-41cc-a7bd-b0f9b9148179-kube-api-access-2rsp8\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-textfile\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-wtmp\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-tls\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185880 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-root\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185879 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-sys\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-metrics-client-ca\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.185988 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-wtmp\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.186108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.186163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.186221 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-textfile\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186551 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.186528 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-metrics-client-ca\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.186705 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.186686 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-accelerators-collector-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.188230 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.188204 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-tls\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.188331 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.188279 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/edccba44-31a2-41cc-a7bd-b0f9b9148179-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.199271 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.199249 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rsp8\" (UniqueName: \"kubernetes.io/projected/edccba44-31a2-41cc-a7bd-b0f9b9148179-kube-api-access-2rsp8\") pod \"node-exporter-hj8cb\" (UID: \"edccba44-31a2-41cc-a7bd-b0f9b9148179\") " pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.214001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.213972 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hj8cb" Aug 05 17:15:27.222047 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.222020 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:27.226338 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:27.226313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedccba44_31a2_41cc_a7bd_b0f9b9148179.slice/crio-6777167a6dacc7beb146a48b6c9d3322daaf284b768acd5d9805b65232b12cca WatchSource:0}: Error finding container 6777167a6dacc7beb146a48b6c9d3322daaf284b768acd5d9805b65232b12cca: Status 404 returned error can't find the container with id 6777167a6dacc7beb146a48b6c9d3322daaf284b768acd5d9805b65232b12cca Aug 05 17:15:27.315379 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.315347 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:27.538861 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.538790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:27.590378 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.590340 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.592781 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.592757 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6c111edd-d5be-4cb2-a35d-fa27c1800ab5-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-vvhdt\" (UID: \"6c111edd-d5be-4cb2-a35d-fa27c1800ab5\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.667934 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.667828 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:27.774520 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.774482 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" Aug 05 17:15:27.935031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.934971 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt"] Aug 05 17:15:27.953579 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:27.953547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj8cb" event={"ID":"edccba44-31a2-41cc-a7bd-b0f9b9148179","Type":"ContainerStarted","Data":"6777167a6dacc7beb146a48b6c9d3322daaf284b768acd5d9805b65232b12cca"} Aug 05 17:15:28.000627 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.000593 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:28.113418 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:28.113347 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c111edd_d5be_4cb2_a35d_fa27c1800ab5.slice/crio-d2c7749a66ba01607ad40d1b72db6bf4fcf9db41d80c2afc9e1f0d1992a02526 WatchSource:0}: Error finding container d2c7749a66ba01607ad40d1b72db6bf4fcf9db41d80c2afc9e1f0d1992a02526: Status 404 returned error can't find the container with id d2c7749a66ba01607ad40d1b72db6bf4fcf9db41d80c2afc9e1f0d1992a02526 Aug 05 17:15:28.187408 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.187385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:28.347828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.347789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:28.960156 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.960120 2558 generic.go:356] "Generic (PLEG): container finished" podID="edccba44-31a2-41cc-a7bd-b0f9b9148179" containerID="8e53cc34cf6ae0f71b48614f5a99288476e9d44fb51411ef70baf348dc480f36" exitCode=0 Aug 05 17:15:28.960598 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.960220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj8cb" event={"ID":"edccba44-31a2-41cc-a7bd-b0f9b9148179","Type":"ContainerDied","Data":"8e53cc34cf6ae0f71b48614f5a99288476e9d44fb51411ef70baf348dc480f36"} Aug 05 17:15:28.962456 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.962435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" event={"ID":"6c111edd-d5be-4cb2-a35d-fa27c1800ab5","Type":"ContainerStarted","Data":"17e52980e98a699230231e1c0a45de4739f16502f947a029a5d92bfc9b71b851"} Aug 05 17:15:28.962568 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.962487 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" event={"ID":"6c111edd-d5be-4cb2-a35d-fa27c1800ab5","Type":"ContainerStarted","Data":"a58acfb930acc108131589b8e1e3a87a7958dbfaee00e56c79d490893d6f7022"} Aug 05 17:15:28.962568 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:28.962517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" event={"ID":"6c111edd-d5be-4cb2-a35d-fa27c1800ab5","Type":"ContainerStarted","Data":"d2c7749a66ba01607ad40d1b72db6bf4fcf9db41d80c2afc9e1f0d1992a02526"} Aug 05 17:15:29.254767 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:29.254683 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:29.364298 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:29.364263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:29.968262 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:29.968228 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj8cb" event={"ID":"edccba44-31a2-41cc-a7bd-b0f9b9148179","Type":"ContainerStarted","Data":"a5ba4698bd0f15d1738cd98bb3f7a498dcfd7fd69e4844e94671c72743aa1ca5"} Aug 05 17:15:29.968748 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:29.968286 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hj8cb" event={"ID":"edccba44-31a2-41cc-a7bd-b0f9b9148179","Type":"ContainerStarted","Data":"6f970f01b6586df0da056e2c8ed63663fa8fcec504457d78209bea3f0be703c3"} Aug 05 17:15:29.970438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:29.970414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" event={"ID":"6c111edd-d5be-4cb2-a35d-fa27c1800ab5","Type":"ContainerStarted","Data":"34515595358ab335310dd1237eeac84b72894d3f2b46b3e03fb277cfee7c76af"} Aug 05 17:15:30.005553 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.005508 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hj8cb" podStartSLOduration=3.014098203 podStartE2EDuration="4.005493258s" totalImagesPullingTime="915.899001ms" totalInitContainerRuntime="75.496054ms" isStatefulPod=true podCreationTimestamp="2026-08-05 17:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:30.003196594 +0000 UTC m=+192.163124183" watchObservedRunningTime="2026-08-05 17:15:30.005493258 +0000 UTC m=+192.165420848" Aug 05 17:15:30.029102 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.029056 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-vvhdt" podStartSLOduration=2.99214426 podStartE2EDuration="4.029037474s" totalImagesPullingTime="1.036893214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:30.028158164 +0000 UTC m=+192.188085779" watchObservedRunningTime="2026-08-05 17:15:30.029037474 +0000 UTC m=+192.188965065" Aug 05 17:15:30.180284 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.180247 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:30.282060 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.281980 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:30.386594 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.386551 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:30.497912 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:30.497882 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:31.675371 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:31.675341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:32.063852 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:32.063768 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:15:32.182246 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:32.182210 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:32.274031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:32.273999 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:32.559200 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:32.559168 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:33.231212 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.231179 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:33.344158 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.344126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:33.517477 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.517385 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:33.520652 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.520616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.524005 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.523981 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 17:15:33.524180 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524011 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 17:15:33.524298 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524039 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a8v28jq9p4sts\"" Aug 05 17:15:33.524370 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524051 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 17:15:33.524433 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524408 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 17:15:33.524709 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524693 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-25gn6\"" Aug 05 17:15:33.524789 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.524699 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 17:15:33.526101 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526085 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 17:15:33.526201 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526098 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 17:15:33.526201 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526093 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 17:15:33.526346 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526332 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 17:15:33.526460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526447 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 17:15:33.526686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.526668 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 17:15:33.527254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.527236 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 17:15:33.528490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.528457 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 17:15:33.529285 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.529268 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 17:15:33.532182 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.532162 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 17:15:33.537390 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.537361 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:33.538932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.538908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539008 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.538949 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539008 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.538980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539114 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539114 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539114 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539109 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2fj9\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539228 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539193 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539228 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539214 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539279 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539424 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539424 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539424 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539424 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.539609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.539568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.550936 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.550909 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:33.640813 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.640813 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640814 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641031 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.640919 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641122 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641220 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641279 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641460 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2fj9\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641548 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641609 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641935 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641706 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.641935 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.641822 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.642153 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.642130 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.642964 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.642193 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.642964 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.642215 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644200 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644093 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644200 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644546 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644393 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644546 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644427 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644546 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644479 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.644916 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.644858 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.645888 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.645838 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.646423 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.646402 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.646679 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.646657 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.646764 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.646717 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.646805 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.646762 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.647050 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.647034 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.647097 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.647083 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.658892 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.658871 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2fj9\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9\") pod \"prometheus-k8s-0\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.833407 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.833316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:33.998160 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:33.998124 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:15:34.002391 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:15:34.002366 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a71def_3d84_4684_804b_1a99ca0a4c29.slice/crio-0af969e5e5129d1f864e8206646ee3ce783ca9372ad50c6bbae3152fd24f8123 WatchSource:0}: Error finding container 0af969e5e5129d1f864e8206646ee3ce783ca9372ad50c6bbae3152fd24f8123: Status 404 returned error can't find the container with id 0af969e5e5129d1f864e8206646ee3ce783ca9372ad50c6bbae3152fd24f8123 Aug 05 17:15:34.990145 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:34.990117 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"0af969e5e5129d1f864e8206646ee3ce783ca9372ad50c6bbae3152fd24f8123"} Aug 05 17:15:35.994557 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:35.994518 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="3288b9663df773061308907de8c6ae2fcf4bd1e9fc8eddcd12a7eb44ca125124" exitCode=0 Aug 05 17:15:35.994943 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:35.994566 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"3288b9663df773061308907de8c6ae2fcf4bd1e9fc8eddcd12a7eb44ca125124"} Aug 05 17:15:36.317001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:36.316924 2558 scope.go:117] "RemoveContainer" containerID="0d120b84667c249a57f4578c7069189fe2b32f90815e5f07a430f12f117e3869" Aug 05 17:15:37.001019 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.000986 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:15:37.001432 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.001048 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" event={"ID":"62a008db-636a-4cc2-a080-55a194c06ba9","Type":"ContainerStarted","Data":"a7974ae2809d767074df493644d97006270c11fd3239cdcaab8def0728a1a93c"} Aug 05 17:15:37.001432 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.001309 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:15:37.006093 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.006064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" Aug 05 17:15:37.032339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.032277 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-vvxlc" podStartSLOduration=51.886636708 podStartE2EDuration="55.032257657s" totalImagesPullingTime="3.145620949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:37.030464814 +0000 UTC m=+199.190392408" watchObservedRunningTime="2026-08-05 17:15:37.032257657 +0000 UTC m=+199.192185249" Aug 05 17:15:37.060425 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.060396 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.191206 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.191174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.352385 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.352304 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.532523 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.532463 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.701428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.701392 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.806454 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.806412 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:37.903692 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:37.903662 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:38.002509 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:38.002425 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:38.925035 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:38.925002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:39.118872 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:39.118842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:39.348175 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:39.348134 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:39.793500 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:39.793467 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:39.893624 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:39.893585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:39.992595 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:39.992549 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:40.017364 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:40.017330 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"a4ee4b413168a277d0248aba45ae62e0b97261cf006efc08fb7b92bad3985e45"} Aug 05 17:15:40.017550 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:40.017397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"5e18a57c3a79b19295f9f2d094dd588faf7e2bc357df5d392f54d1975a2426d9"} Aug 05 17:15:41.027708 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:41.027675 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"db9b13b8c5c5c6c23cf037e8a41c172a1b3fb448681f7a9ac4d02e4494f1e445"} Aug 05 17:15:41.028023 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:41.027752 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"936c2029197ddeffc40128231e9979c0132c8dce26b6f03fdf7ba0c463240ac8"} Aug 05 17:15:42.039260 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:42.039225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"63cc470563b745a5e4205a016cfa0482d37b8ed1cce3a671ff55f02cb57dd70a"} Aug 05 17:15:42.039686 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:42.039311 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerStarted","Data":"fdb01ebef4b00b0e7dff54bcf58218be603889c42faeaaec75a78f08060aaa3b"} Aug 05 17:15:42.076047 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:42.075981 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.341850961 podStartE2EDuration="9.075958196s" totalImagesPullingTime="5.716037881s" totalInitContainerRuntime="18.069354ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:42.073458632 +0000 UTC m=+204.233386215" watchObservedRunningTime="2026-08-05 17:15:42.075958196 +0000 UTC m=+204.235885788" Aug 05 17:15:43.833411 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:43.833374 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:15:45.127422 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:45.127387 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:45.191561 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:45.191527 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:47.333707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:47.333670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:51.750538 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:51.750503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:51.826428 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:51.826401 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:54.872128 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:54.872096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:54.949026 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:54.948993 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:55.057183 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:55.057152 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:55.157399 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:55.157368 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:55.228830 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:55.228805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:55.377368 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:55.377338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:57.082590 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.082551 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerName="registry" containerID="cri-o://d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8" gracePeriod=30 Aug 05 17:15:57.325035 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.325008 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:57.462089 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462059 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462103 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462120 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462144 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462177 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462195 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k9462\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462234 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462258 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462255 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets\") pod \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\" (UID: \"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158\") " Aug 05 17:15:57.462682 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462611 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:57.462865 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.462831 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:15:57.464939 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.464912 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:57.465045 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.464923 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462" (OuterVolumeSpecName: "kube-api-access-k9462") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "kube-api-access-k9462". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:57.465045 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.464941 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:57.465045 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.465007 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:15:57.465213 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.465044 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:15:57.470151 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.470127 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" (UID: "1bf11b46-f3d6-4d6e-96e7-e363a1ffb158"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:15:57.563744 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563713 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-trusted-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563744 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563738 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k9462\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-kube-api-access-k9462\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563744 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563748 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563759 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-installation-pull-secrets\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563767 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-image-registry-private-configuration\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563776 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-ca-trust-extracted\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563784 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-registry-certificates\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.563953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.563793 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158-bound-sa-token\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:15:57.943398 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:57.943366 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:58.039619 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.039582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:58.097052 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.097013 2558 generic.go:356] "Generic (PLEG): container finished" podID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerID="d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8" exitCode=0 Aug 05 17:15:58.097052 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.097059 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" Aug 05 17:15:58.097509 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.097064 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" event={"ID":"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158","Type":"ContainerDied","Data":"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8"} Aug 05 17:15:58.097509 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.097113 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dbf54dff7-lsfdk" event={"ID":"1bf11b46-f3d6-4d6e-96e7-e363a1ffb158","Type":"ContainerDied","Data":"d136375d5692dcd0d52a72a6907ab5bc29015c35a7fa106b372060f546494659"} Aug 05 17:15:58.097509 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.097140 2558 scope.go:117] "RemoveContainer" containerID="d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8" Aug 05 17:15:58.106932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.106913 2558 scope.go:117] "RemoveContainer" containerID="d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8" Aug 05 17:15:58.107208 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:15:58.107191 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8\": container with ID starting with d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8 not found: ID does not exist" containerID="d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8" Aug 05 17:15:58.107249 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.107216 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8"} err="failed to get container status \"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8\": rpc error: code = NotFound desc = could not find container \"d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8\": container with ID starting with d0b1fdb0cbb4716684516abb7a45899c234c50d82af35413d0c63ad291473da8 not found: ID does not exist" Aug 05 17:15:58.119387 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.119360 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:15:58.125568 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.125546 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-dbf54dff7-lsfdk"] Aug 05 17:15:58.322017 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.321940 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" path="/var/lib/kubelet/pods/1bf11b46-f3d6-4d6e-96e7-e363a1ffb158/volumes" Aug 05 17:15:58.724806 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.724769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:15:58.786320 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:15:58.786282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:04.344683 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:04.344652 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:07.043594 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:07.043562 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:07.145215 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:07.145184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:07.233612 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:07.233586 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:07.633213 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:07.633183 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:13.150840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:13.150807 2558 generic.go:356] "Generic (PLEG): container finished" podID="82b231cc-138d-4c1f-9d33-769d16907f7e" containerID="cd53a872140594ade04cc307db1318113d65aae166b4e7869f0489aad55afffa" exitCode=0 Aug 05 17:16:13.151235 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:13.150881 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-svfhd" event={"ID":"82b231cc-138d-4c1f-9d33-769d16907f7e","Type":"ContainerDied","Data":"cd53a872140594ade04cc307db1318113d65aae166b4e7869f0489aad55afffa"} Aug 05 17:16:13.151235 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:13.151195 2558 scope.go:117] "RemoveContainer" containerID="cd53a872140594ade04cc307db1318113d65aae166b4e7869f0489aad55afffa" Aug 05 17:16:14.155552 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:14.155517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-svfhd" event={"ID":"82b231cc-138d-4c1f-9d33-769d16907f7e","Type":"ContainerStarted","Data":"971120824bed8922743638cfad7d575222b3252afd4084e694d5a4d1b809b491"} Aug 05 17:16:17.168473 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:17.168390 2558 generic.go:356] "Generic (PLEG): container finished" podID="c82f7016-607a-4d26-8fd7-21544c402ed5" containerID="e33f40e83b629d96a76f705524f9b2d61df70bcb63db9b952ab54ef93c62dc63" exitCode=0 Aug 05 17:16:17.168473 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:17.168444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" event={"ID":"c82f7016-607a-4d26-8fd7-21544c402ed5","Type":"ContainerDied","Data":"e33f40e83b629d96a76f705524f9b2d61df70bcb63db9b952ab54ef93c62dc63"} Aug 05 17:16:17.168925 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:17.168730 2558 scope.go:117] "RemoveContainer" containerID="e33f40e83b629d96a76f705524f9b2d61df70bcb63db9b952ab54ef93c62dc63" Aug 05 17:16:18.174346 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:18.174309 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-zbvs5" event={"ID":"c82f7016-607a-4d26-8fd7-21544c402ed5","Type":"ContainerStarted","Data":"4c1d7381634dd5b4b22ac84ee357f5244dec68b1d592340af334860b9166078c"} Aug 05 17:16:22.189071 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:22.189042 2558 generic.go:356] "Generic (PLEG): container finished" podID="ef7a1c65-14e9-4fbd-870e-6d7d40773a2d" containerID="ee0435be8bb0f7b802168acf002824d0f22b9701955ef2c65066a1d1a7701421" exitCode=0 Aug 05 17:16:22.189349 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:22.189088 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" event={"ID":"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d","Type":"ContainerDied","Data":"ee0435be8bb0f7b802168acf002824d0f22b9701955ef2c65066a1d1a7701421"} Aug 05 17:16:22.189435 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:22.189419 2558 scope.go:117] "RemoveContainer" containerID="ee0435be8bb0f7b802168acf002824d0f22b9701955ef2c65066a1d1a7701421" Aug 05 17:16:23.198270 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:23.198232 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-7zrvv" event={"ID":"ef7a1c65-14e9-4fbd-870e-6d7d40773a2d","Type":"ContainerStarted","Data":"b2edb8e3f2e604eb09c755f15f0e0ba1a9ce908773d31cdae2350872413dbb36"} Aug 05 17:16:24.867302 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:24.867275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:24.967880 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:24.967841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:30.220876 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:30.220839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:16:30.223018 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:30.222998 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da13f392-8652-4de4-a260-9fb0c690bf43-metrics-certs\") pod \"network-metrics-daemon-lps6b\" (UID: \"da13f392-8652-4de4-a260-9fb0c690bf43\") " pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:16:30.320694 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:30.320662 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9xpb\"" Aug 05 17:16:30.327930 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:30.327908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lps6b" Aug 05 17:16:30.455149 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:30.455013 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lps6b"] Aug 05 17:16:30.457731 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:16:30.457704 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda13f392_8652_4de4_a260_9fb0c690bf43.slice/crio-43e33e880f00fc70f9e857d01ce6cc2298a90719546899d9f79918bf1ce87b14 WatchSource:0}: Error finding container 43e33e880f00fc70f9e857d01ce6cc2298a90719546899d9f79918bf1ce87b14: Status 404 returned error can't find the container with id 43e33e880f00fc70f9e857d01ce6cc2298a90719546899d9f79918bf1ce87b14 Aug 05 17:16:31.231275 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:31.231234 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lps6b" event={"ID":"da13f392-8652-4de4-a260-9fb0c690bf43","Type":"ContainerStarted","Data":"43e33e880f00fc70f9e857d01ce6cc2298a90719546899d9f79918bf1ce87b14"} Aug 05 17:16:32.236843 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:32.236809 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lps6b" event={"ID":"da13f392-8652-4de4-a260-9fb0c690bf43","Type":"ContainerStarted","Data":"6149f058abd49a383c10e6ea49a2d4114ef2b32765e19825100333f5585473c5"} Aug 05 17:16:32.237209 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:32.236864 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lps6b" event={"ID":"da13f392-8652-4de4-a260-9fb0c690bf43","Type":"ContainerStarted","Data":"091e9660fe7c0b265b9ad0a71b9b59127d7f8b2fed2f8c5d075cb943d64ceee1"} Aug 05 17:16:32.256460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:32.256412 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lps6b" podStartSLOduration=253.175839364 podStartE2EDuration="4m14.256397843s" totalImagesPullingTime="1.080558479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:32.255680684 +0000 UTC m=+254.415608276" watchObservedRunningTime="2026-08-05 17:16:32.256397843 +0000 UTC m=+254.416325433" Aug 05 17:16:32.365219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:32.365184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:32.434941 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:32.434906 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:33.833840 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:33.833800 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:33.849231 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:33.849202 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:34.259367 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:34.259333 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:43.498187 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:43.498104 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:43.593302 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:43.593266 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:46.651621 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:46.651584 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:47.070811 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:47.070718 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:52.149868 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.149834 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:52.150278 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150149 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="prometheus" containerID="cri-o://5e18a57c3a79b19295f9f2d094dd588faf7e2bc357df5d392f54d1975a2426d9" gracePeriod=600 Aug 05 17:16:52.150278 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150174 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy" containerID="cri-o://fdb01ebef4b00b0e7dff54bcf58218be603889c42faeaaec75a78f08060aaa3b" gracePeriod=600 Aug 05 17:16:52.150278 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150205 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="thanos-sidecar" containerID="cri-o://936c2029197ddeffc40128231e9979c0132c8dce26b6f03fdf7ba0c463240ac8" gracePeriod=600 Aug 05 17:16:52.150278 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150203 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="config-reloader" containerID="cri-o://a4ee4b413168a277d0248aba45ae62e0b97261cf006efc08fb7b92bad3985e45" gracePeriod=600 Aug 05 17:16:52.150490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150255 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-web" containerID="cri-o://db9b13b8c5c5c6c23cf037e8a41c172a1b3fb448681f7a9ac4d02e4494f1e445" gracePeriod=600 Aug 05 17:16:52.150490 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.150310 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-thanos" containerID="cri-o://63cc470563b745a5e4205a016cfa0482d37b8ed1cce3a671ff55f02cb57dd70a" gracePeriod=600 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315114 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="63cc470563b745a5e4205a016cfa0482d37b8ed1cce3a671ff55f02cb57dd70a" exitCode=0 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315137 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="fdb01ebef4b00b0e7dff54bcf58218be603889c42faeaaec75a78f08060aaa3b" exitCode=0 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315145 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="db9b13b8c5c5c6c23cf037e8a41c172a1b3fb448681f7a9ac4d02e4494f1e445" exitCode=0 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315151 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="936c2029197ddeffc40128231e9979c0132c8dce26b6f03fdf7ba0c463240ac8" exitCode=0 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315156 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="a4ee4b413168a277d0248aba45ae62e0b97261cf006efc08fb7b92bad3985e45" exitCode=0 Aug 05 17:16:52.315150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315162 2558 generic.go:356] "Generic (PLEG): container finished" podID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerID="5e18a57c3a79b19295f9f2d094dd588faf7e2bc357df5d392f54d1975a2426d9" exitCode=0 Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315186 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"63cc470563b745a5e4205a016cfa0482d37b8ed1cce3a671ff55f02cb57dd70a"} Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"fdb01ebef4b00b0e7dff54bcf58218be603889c42faeaaec75a78f08060aaa3b"} Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315304 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"db9b13b8c5c5c6c23cf037e8a41c172a1b3fb448681f7a9ac4d02e4494f1e445"} Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"936c2029197ddeffc40128231e9979c0132c8dce26b6f03fdf7ba0c463240ac8"} Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"a4ee4b413168a277d0248aba45ae62e0b97261cf006efc08fb7b92bad3985e45"} Aug 05 17:16:52.315530 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.315418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"5e18a57c3a79b19295f9f2d094dd588faf7e2bc357df5d392f54d1975a2426d9"} Aug 05 17:16:52.404322 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.404267 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:52.495604 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495574 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495604 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495609 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2fj9\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495647 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495667 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495686 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495722 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495755 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.495860 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.495789 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496153 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496116 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.496247 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496231 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496303 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496275 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496355 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496305 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496355 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496330 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496451 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496356 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496451 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496378 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496557 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496413 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496606 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496564 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496676 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496602 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.496676 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496618 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496795 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.496961 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497172 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497479 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497599 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.497657 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497661 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.497993 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497705 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca\") pod \"84a71def-3d84-4684-804b-1a99ca0a4c29\" (UID: \"84a71def-3d84-4684-804b-1a99ca0a4c29\") " Aug 05 17:16:52.497993 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497959 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.497993 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497980 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.498129 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.497995 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.498129 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.498010 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-k8s-db\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.498129 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.498024 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.498129 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.498039 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.498404 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.498379 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.498969 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.498939 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.499122 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.499101 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config" (OuterVolumeSpecName: "config") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.499195 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.499171 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:16:52.499763 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.499717 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out" (OuterVolumeSpecName: "config-out") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:16:52.499763 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.499719 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.499912 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.499772 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.500744 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.500720 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.500861 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.500840 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9" (OuterVolumeSpecName: "kube-api-access-m2fj9") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "kube-api-access-m2fj9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:52.500936 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.500847 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.500936 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.500909 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.501023 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.501013 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.501074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.501043 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:16:52.510798 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.510778 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config" (OuterVolumeSpecName: "web-config") pod "84a71def-3d84-4684-804b-1a99ca0a4c29" (UID: "84a71def-3d84-4684-804b-1a99ca0a4c29"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:16:52.598393 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598364 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-grpc-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598393 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598389 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598393 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598398 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-kube-rbac-proxy\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598407 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598415 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-tls-assets\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598424 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598431 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84a71def-3d84-4684-804b-1a99ca0a4c29-config-out\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598439 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598447 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-web-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598455 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598463 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84a71def-3d84-4684-804b-1a99ca0a4c29-configmap-metrics-client-ca\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598471 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2fj9\" (UniqueName: \"kubernetes.io/projected/84a71def-3d84-4684-804b-1a99ca0a4c29-kube-api-access-m2fj9\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598480 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-metrics-client-certs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:52.598592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:52.598488 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84a71def-3d84-4684-804b-1a99ca0a4c29-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:16:53.321597 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.321562 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84a71def-3d84-4684-804b-1a99ca0a4c29","Type":"ContainerDied","Data":"0af969e5e5129d1f864e8206646ee3ce783ca9372ad50c6bbae3152fd24f8123"} Aug 05 17:16:53.322026 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.321623 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.322026 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.321655 2558 scope.go:117] "RemoveContainer" containerID="63cc470563b745a5e4205a016cfa0482d37b8ed1cce3a671ff55f02cb57dd70a" Aug 05 17:16:53.331602 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.331581 2558 scope.go:117] "RemoveContainer" containerID="fdb01ebef4b00b0e7dff54bcf58218be603889c42faeaaec75a78f08060aaa3b" Aug 05 17:16:53.338339 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.338325 2558 scope.go:117] "RemoveContainer" containerID="db9b13b8c5c5c6c23cf037e8a41c172a1b3fb448681f7a9ac4d02e4494f1e445" Aug 05 17:16:53.344514 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.344496 2558 scope.go:117] "RemoveContainer" containerID="936c2029197ddeffc40128231e9979c0132c8dce26b6f03fdf7ba0c463240ac8" Aug 05 17:16:53.350953 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.350937 2558 scope.go:117] "RemoveContainer" containerID="a4ee4b413168a277d0248aba45ae62e0b97261cf006efc08fb7b92bad3985e45" Aug 05 17:16:53.354300 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.354279 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:53.357701 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.357684 2558 scope.go:117] "RemoveContainer" containerID="5e18a57c3a79b19295f9f2d094dd588faf7e2bc357df5d392f54d1975a2426d9" Aug 05 17:16:53.361948 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.361920 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:53.364538 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.364522 2558 scope.go:117] "RemoveContainer" containerID="3288b9663df773061308907de8c6ae2fcf4bd1e9fc8eddcd12a7eb44ca125124" Aug 05 17:16:53.397893 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.397870 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:53.398165 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398151 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="prometheus" Aug 05 17:16:53.398204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398167 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="prometheus" Aug 05 17:16:53.398204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398180 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="thanos-sidecar" Aug 05 17:16:53.398204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398185 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="thanos-sidecar" Aug 05 17:16:53.398204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398195 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:53.398204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398200 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398209 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-web" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398214 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-web" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398222 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398229 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398237 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="init-config-reloader" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398242 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="init-config-reloader" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398252 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="config-reloader" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398257 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="config-reloader" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398263 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerName="registry" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398268 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerName="registry" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398310 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398317 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="prometheus" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398325 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="thanos-sidecar" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398331 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bf11b46-f3d6-4d6e-96e7-e363a1ffb158" containerName="registry" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398337 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-web" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398342 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="config-reloader" Aug 05 17:16:53.398344 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.398348 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" containerName="kube-rbac-proxy-thanos" Aug 05 17:16:53.403651 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.403623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.409078 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409059 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 05 17:16:53.409167 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409149 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 05 17:16:53.409228 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409180 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 05 17:16:53.409293 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409261 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 05 17:16:53.409349 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409293 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 05 17:16:53.409458 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409444 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 05 17:16:53.409510 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.409446 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 05 17:16:53.419269 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.419226 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 05 17:16:53.419472 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.419411 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 05 17:16:53.419784 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.419770 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a8v28jq9p4sts\"" Aug 05 17:16:53.420351 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.420339 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 05 17:16:53.420393 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.420365 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 05 17:16:53.420445 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.420365 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-25gn6\"" Aug 05 17:16:53.425803 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.425790 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 05 17:16:53.426146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.426129 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 05 17:16:53.428685 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.428662 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 05 17:16:53.437343 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.437326 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 05 17:16:53.441983 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.441962 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:53.504519 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504519 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504520 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504546 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504582 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504651 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz762\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-kube-api-access-sz762\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504765 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504783 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504822 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.504858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504899 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504961 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504977 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.505054 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.504994 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605416 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605420 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605453 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605472 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605489 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605506 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605535 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605585 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605661 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.605778 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606125 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605796 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606125 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605825 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606125 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605849 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz762\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-kube-api-access-sz762\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606125 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.605880 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606125 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.606048 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.606361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.606139 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.607977 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.606711 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.607977 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.607253 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608482 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608591 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-web-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608688 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608788 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608804 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608833 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.608912 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.609348 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610254 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.609603 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.610937 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.610906 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.611032 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.610981 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e4268498-5795-4bf9-a777-63e200c1ecdd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.611097 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.611077 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-config\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.611146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.611125 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.611369 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.611351 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e4268498-5795-4bf9-a777-63e200c1ecdd-config-out\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.611431 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.611415 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e4268498-5795-4bf9-a777-63e200c1ecdd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.617963 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.617945 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz762\" (UniqueName: \"kubernetes.io/projected/e4268498-5795-4bf9-a777-63e200c1ecdd-kube-api-access-sz762\") pod \"prometheus-k8s-0\" (UID: \"e4268498-5795-4bf9-a777-63e200c1ecdd\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.712526 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.712434 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:16:53.856274 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:53.856252 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 05 17:16:53.857786 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:16:53.857762 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4268498_5795_4bf9_a777_63e200c1ecdd.slice/crio-4b93534e79e5c17f02f49456382a140756b7b0c97db2c4d82e9bf515a2c6b80f WatchSource:0}: Error finding container 4b93534e79e5c17f02f49456382a140756b7b0c97db2c4d82e9bf515a2c6b80f: Status 404 returned error can't find the container with id 4b93534e79e5c17f02f49456382a140756b7b0c97db2c4d82e9bf515a2c6b80f Aug 05 17:16:54.321600 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.321558 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84a71def-3d84-4684-804b-1a99ca0a4c29" path="/var/lib/kubelet/pods/84a71def-3d84-4684-804b-1a99ca0a4c29/volumes" Aug 05 17:16:54.327430 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.327397 2558 generic.go:356] "Generic (PLEG): container finished" podID="e4268498-5795-4bf9-a777-63e200c1ecdd" containerID="1d484268877c6d7e429c2b7d3f0b7f3c1d8cc4ce0984b7a14711c3555b8fdaa1" exitCode=0 Aug 05 17:16:54.327564 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.327454 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerDied","Data":"1d484268877c6d7e429c2b7d3f0b7f3c1d8cc4ce0984b7a14711c3555b8fdaa1"} Aug 05 17:16:54.327564 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.327518 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"4b93534e79e5c17f02f49456382a140756b7b0c97db2c4d82e9bf515a2c6b80f"} Aug 05 17:16:54.348531 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.348507 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:54.451293 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:54.451267 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:16:55.334446 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334408 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"a473e650c95d87fa98cfc68e61b0de46b7e545bc82837432e86e59f57961dbac"} Aug 05 17:16:55.334932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"23becc5a83842a14e6e990f8d0909aa522ffb80964f791bf466ee90feab86181"} Aug 05 17:16:55.334932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"a20bfd93d4413ff039778580cb042b990c9e2f71751023f0c80f873937941398"} Aug 05 17:16:55.334932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334606 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"e1b9871b9eda3e71bb7fb50fc4231bc1a8a164fe514904272b3e36aa0f983a62"} Aug 05 17:16:55.334932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"65e492f5306bede8211c4ff6f15d550612af98c95b487e7e8b213e9353d66c23"} Aug 05 17:16:55.334932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.334699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e4268498-5795-4bf9-a777-63e200c1ecdd","Type":"ContainerStarted","Data":"3a5dafc808d62f932bc83625412708bcafd2b8c82bee751f6ba58aa719690e77"} Aug 05 17:16:55.376927 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:55.376877 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.354653028 podStartE2EDuration="2.376861303s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.208275ms" isStatefulPod=false podCreationTimestamp="2026-08-05 17:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:16:55.374682039 +0000 UTC m=+277.534609632" watchObservedRunningTime="2026-08-05 17:16:55.376861303 +0000 UTC m=+277.536788894" Aug 05 17:16:58.713324 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:16:58.713287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:05.300515 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:05.300478 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:05.407722 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:05.407694 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:05.601812 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:05.601725 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:18.264271 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:18.264242 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:17:18.267524 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:18.267502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:17:18.271900 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:18.271878 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:17:18.277917 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:18.277896 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:17:18.279895 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:18.279881 2558 kubelet.go:1648] "Image garbage collection succeeded" Aug 05 17:17:35.187489 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:35.187455 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:43.781653 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:43.781602 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:43.862774 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:43.862743 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:17:53.712942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:53.712905 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:53.728061 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:53.728035 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:17:54.560932 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:17:54.560899 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 05 17:18:01.892533 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:01.892488 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:01.971628 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:01.971598 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:13.938021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:13.937940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:14.005974 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:14.005940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:24.920761 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:24.920723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:25.070929 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:25.070896 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:29.229184 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:29.229151 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:37.179903 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:37.179867 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:37.252982 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:37.252942 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:47.652672 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:47.652616 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:47.754328 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:47.754295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:18:47.837821 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:18:47.837785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:19:42.096748 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:19:42.096677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:19:43.585124 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:19:43.585092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:04.213130 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:04.213096 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:04.322723 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:04.322690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:04.528994 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:04.528917 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:04.628275 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:04.628238 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:10.376993 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:10.376960 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:10.673046 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:10.673012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:10.864914 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:10.864884 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:11.193059 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:11.193025 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:11.395196 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:11.395163 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:11.742059 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:11.742021 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:11.839098 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:11.839067 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:11.941413 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:11.941378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:12.188536 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:12.188494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:12.260706 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:12.260666 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:12.464265 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:12.464188 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:20:12.565006 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:20:12.564966 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:03.738107 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:03.738073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:03.804802 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:03.804766 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:24.446588 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:24.446508 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:34.525841 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:34.525811 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:34.605993 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:34.605962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:34.677373 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:34.677343 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:34.778352 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:34.778295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:34.890110 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:34.890083 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:35.422829 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:35.422798 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:35.505732 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:35.505705 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:21:35.605869 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:21:35.605842 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:18.293079 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:18.293049 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:22:18.294233 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:18.294211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:22:18.301813 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:18.301789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:22:18.302691 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:18.302669 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:22:52.804488 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:52.804410 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:52.917047 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:52.917013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:53.012864 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:53.012827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:53.205926 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:53.205894 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:53.364783 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:53.364749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:53.754084 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:53.754049 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:22:53.854347 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:22:53.854315 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:23:09.883737 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:09.883701 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:23:10.396591 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.396564 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-wj8vk"] Aug 05 17:23:10.399727 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.399711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.405890 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.405871 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Aug 05 17:23:10.405970 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.405874 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Aug 05 17:23:10.406942 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.406926 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-sxhkx\"" Aug 05 17:23:10.407056 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.406978 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Aug 05 17:23:10.429435 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.429414 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-wj8vk"] Aug 05 17:23:10.526762 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.526721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5bx\" (UniqueName: \"kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.526938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.526801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.627709 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.627676 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5bx\" (UniqueName: \"kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.627911 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.627753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.628146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.628126 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.638334 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.638311 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5bx\" (UniqueName: \"kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx\") pod \"s3-init-wj8vk\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.716950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.716873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-wj8vk" Aug 05 17:23:10.843850 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.843826 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-wj8vk"] Aug 05 17:23:10.846226 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:23:10.846197 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde77d659_2b3e_45b7_ac0c_a038abbc3c2b.slice/crio-a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7 WatchSource:0}: Error finding container a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7: Status 404 returned error can't find the container with id a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7 Aug 05 17:23:10.848433 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:10.848418 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 17:23:11.717732 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:11.717691 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerStarted","Data":"a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7"} Aug 05 17:23:14.732903 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:14.732865 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerStarted","Data":"ff2a74dbcb259d69e0aeee99875cb2aa12ad7ca2927f7a166ab48b1ba9b1ddc1"} Aug 05 17:23:16.744187 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:16.744153 2558 generic.go:356] "Generic (PLEG): container finished" podID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerID="ff2a74dbcb259d69e0aeee99875cb2aa12ad7ca2927f7a166ab48b1ba9b1ddc1" exitCode=0 Aug 05 17:23:16.744597 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:16.744227 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerDied","Data":"ff2a74dbcb259d69e0aeee99875cb2aa12ad7ca2927f7a166ab48b1ba9b1ddc1"} Aug 05 17:23:21.223958 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:21.223931 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Aug 05 17:23:21.767238 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:21.767200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerStarted","Data":"a7a8e0eed526cf2f7416a5e88fe2c8b46db1f6de79fa9e6e4a8f390a487ad525"} Aug 05 17:23:21.787301 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:23:21.787130 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-wj8vk" podStartSLOduration=2.370141188 podStartE2EDuration="11.787109972s" totalImagesPullingTime="7.841344904s" totalInitContainerRuntime="1.57562388s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:23:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:23:21.786686961 +0000 UTC m=+663.946614546" watchObservedRunningTime="2026-08-05 17:23:21.787109972 +0000 UTC m=+663.947037563" Aug 05 17:24:27.014694 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:27.014658 2558 generic.go:356] "Generic (PLEG): container finished" podID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerID="a7a8e0eed526cf2f7416a5e88fe2c8b46db1f6de79fa9e6e4a8f390a487ad525" exitCode=0 Aug 05 17:24:27.015126 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:27.014700 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerDied","Data":"a7a8e0eed526cf2f7416a5e88fe2c8b46db1f6de79fa9e6e4a8f390a487ad525"} Aug 05 17:24:28.142182 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.142158 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-wj8vk" Aug 05 17:24:28.261977 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.261946 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf5bx\" (UniqueName: \"kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx\") pod \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " Aug 05 17:24:28.262175 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.262010 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache\") pod \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\" (UID: \"de77d659-2b3e-45b7-ac0c-a038abbc3c2b\") " Aug 05 17:24:28.264162 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.264128 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx" (OuterVolumeSpecName: "kube-api-access-kf5bx") pod "de77d659-2b3e-45b7-ac0c-a038abbc3c2b" (UID: "de77d659-2b3e-45b7-ac0c-a038abbc3c2b"). InnerVolumeSpecName "kube-api-access-kf5bx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:24:28.280532 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.280471 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "de77d659-2b3e-45b7-ac0c-a038abbc3c2b" (UID: "de77d659-2b3e-45b7-ac0c-a038abbc3c2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:24:28.362612 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.362575 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf5bx\" (UniqueName: \"kubernetes.io/projected/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-kube-api-access-kf5bx\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:24:28.362612 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:28.362612 2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/de77d659-2b3e-45b7-ac0c-a038abbc3c2b-model-cache\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:24:29.023617 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:29.023594 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-wj8vk" Aug 05 17:24:29.023804 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:29.023588 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-wj8vk" event={"ID":"de77d659-2b3e-45b7-ac0c-a038abbc3c2b","Type":"ContainerDied","Data":"a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7"} Aug 05 17:24:29.023804 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:29.023713 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1fedf9b9710278d03fffb336168479c840c5db5d9981fd74f3f6eb6a2e508d7" Aug 05 17:24:29.386271 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:29.386241 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:29.487818 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:29.487786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:35.649607 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:35.649571 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:40.886485 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.886450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:40.974245 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974209 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:24:40.974561 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974545 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerName="download-hf-model" Aug 05 17:24:40.974659 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974564 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerName="download-hf-model" Aug 05 17:24:40.974659 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974576 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerName="s3-init" Aug 05 17:24:40.974659 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974584 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerName="s3-init" Aug 05 17:24:40.974814 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.974704 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de77d659-2b3e-45b7-ac0c-a038abbc3c2b" containerName="s3-init" Aug 05 17:24:40.977919 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.977898 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:40.980546 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.980522 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Aug 05 17:24:40.980747 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.980649 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Aug 05 17:24:40.980747 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.980682 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Aug 05 17:24:40.980747 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.980693 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Aug 05 17:24:40.981033 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.981018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Aug 05 17:24:40.981611 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.981590 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-5hw69\"" Aug 05 17:24:40.981744 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.981689 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Aug 05 17:24:40.996497 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:40.996473 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:24:41.049950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.049912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.130951 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.130919 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.176179 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.176089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.176179 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.176138 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.176179 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.176165 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.176401 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.176232 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.176401 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.176278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5fjn\" (UniqueName: \"kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.254329 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.254250 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.276718 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.276691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.276718 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.276723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5fjn\" (UniqueName: \"kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.276950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.276769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.276950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.276794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.276950 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.276811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.277304 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.277278 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.277573 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.277544 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.277671 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.277615 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.278044 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.278026 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:24:41.279387 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.279357 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.281514 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.281497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.284679 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.284654 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Aug 05 17:24:41.284791 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.284679 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Aug 05 17:24:41.287370 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.287349 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5fjn\" (UniqueName: \"kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn\") pod \"isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.288243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.288219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:24:41.294287 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.294220 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:24:41.357162 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.357075 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.428421 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.428391 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:24:41.429880 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:24:41.429848 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6659c94_e049_40d7_a9a2_fbd59847eff6.slice/crio-15adfd859ff3a2c285d4ba34652720809adcc148ccfda87802fd3d01af9df389 WatchSource:0}: Error finding container 15adfd859ff3a2c285d4ba34652720809adcc148ccfda87802fd3d01af9df389: Status 404 returned error can't find the container with id 15adfd859ff3a2c285d4ba34652720809adcc148ccfda87802fd3d01af9df389 Aug 05 17:24:41.432997 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.432940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.478802 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.478776 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.478938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.478815 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.478938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.478845 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.478938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.478931 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbpxs\" (UniqueName: \"kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.479097 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.478952 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.499847 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.499827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.577374 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.577303 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:24:41.579331 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.579447 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579341 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.579447 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579371 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.579447 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbpxs\" (UniqueName: \"kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.579609 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.579858 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.579754 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.580190 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.580136 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.580294 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.580247 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.582286 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.582261 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.582381 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.582365 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.583252 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.583228 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:24:41.585416 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.585394 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Aug 05 17:24:41.585508 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.585427 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Aug 05 17:24:41.591252 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.591231 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbpxs\" (UniqueName: \"kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs\") pod \"isvc-xgboost-graph-predictor-555fc69d56-dxz4x\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.601467 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.601445 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:41.618584 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.618559 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:24:41.681210 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.681125 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.681355 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.681249 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.681355 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.681296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7r7x\" (UniqueName: \"kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.681355 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.681343 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.681479 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.681435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.757046 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.757022 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:24:41.759526 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:24:41.759493 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618885d9_612d_4e62_8742_7ce9bf9e7224.slice/crio-0b54fd9d29d9664d59dccdad216e92d23c0d09b6af95d93ba91c56b8c802d8a2 WatchSource:0}: Error finding container 0b54fd9d29d9664d59dccdad216e92d23c0d09b6af95d93ba91c56b8c802d8a2: Status 404 returned error can't find the container with id 0b54fd9d29d9664d59dccdad216e92d23c0d09b6af95d93ba91c56b8c802d8a2 Aug 05 17:24:41.782261 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.782363 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782269 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7r7x\" (UniqueName: \"kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.782363 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782307 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.782473 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.782473 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.782571 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:24:41.782480 2558 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Aug 05 17:24:41.782571 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:24:41.782562 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls podName:74e14104-9c4f-456c-966a-68b55168dc02 nodeName:}" failed. No retries permitted until 2026-08-05 17:24:42.282528291 +0000 UTC m=+744.442455879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls") pod "isvc-sklearn-graph-2-predictor-756656f574-kg87c" (UID: "74e14104-9c4f-456c-966a-68b55168dc02") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found Aug 05 17:24:41.782849 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.782830 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.783038 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.783018 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.783077 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.783025 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.791847 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.791820 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7r7x\" (UniqueName: \"kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:41.876936 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:41.876901 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:24:42.075216 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.075112 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerStarted","Data":"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b"} Aug 05 17:24:42.075216 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.075192 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerStarted","Data":"0b54fd9d29d9664d59dccdad216e92d23c0d09b6af95d93ba91c56b8c802d8a2"} Aug 05 17:24:42.076772 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.076741 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerStarted","Data":"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0"} Aug 05 17:24:42.076871 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.076807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerStarted","Data":"15adfd859ff3a2c285d4ba34652720809adcc148ccfda87802fd3d01af9df389"} Aug 05 17:24:42.285779 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.285745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:42.288036 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.288002 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-756656f574-kg87c\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:42.495509 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.495463 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:24:42.624357 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:42.624240 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:24:42.626449 ip-10-0-135-121 kubenswrapper[2558]: W0805 17:24:42.626424 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74e14104_9c4f_456c_966a_68b55168dc02.slice/crio-f718cefc8aec9d2daa2f8c0140a4f369ae2bf1867008ba9b2655b5b4e3813744 WatchSource:0}: Error finding container f718cefc8aec9d2daa2f8c0140a4f369ae2bf1867008ba9b2655b5b4e3813744: Status 404 returned error can't find the container with id f718cefc8aec9d2daa2f8c0140a4f369ae2bf1867008ba9b2655b5b4e3813744 Aug 05 17:24:43.082284 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:43.082246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerStarted","Data":"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e"} Aug 05 17:24:43.082791 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:43.082307 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerStarted","Data":"f718cefc8aec9d2daa2f8c0140a4f369ae2bf1867008ba9b2655b5b4e3813744"} Aug 05 17:24:46.098851 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:46.098821 2558 generic.go:356] "Generic (PLEG): container finished" podID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerID="4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0" exitCode=0 Aug 05 17:24:46.099287 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:46.098901 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerDied","Data":"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0"} Aug 05 17:24:46.100526 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:46.100464 2558 generic.go:356] "Generic (PLEG): container finished" podID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerID="72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b" exitCode=0 Aug 05 17:24:46.100526 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:46.100497 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerDied","Data":"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b"} Aug 05 17:24:47.124299 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:47.124259 2558 generic.go:356] "Generic (PLEG): container finished" podID="74e14104-9c4f-456c-966a-68b55168dc02" containerID="97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e" exitCode=0 Aug 05 17:24:47.124774 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:24:47.124367 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerDied","Data":"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e"} Aug 05 17:25:14.291508 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:14.291467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerStarted","Data":"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454"} Aug 05 17:25:14.294787 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:14.294756 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerStarted","Data":"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8"} Aug 05 17:25:14.297390 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:14.297361 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerStarted","Data":"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7"} Aug 05 17:25:17.314879 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.314839 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerStarted","Data":"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7"} Aug 05 17:25:17.315340 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.315129 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:25:17.315340 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.315187 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:25:17.316527 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.316494 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:17.317193 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.317166 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerStarted","Data":"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1"} Aug 05 17:25:17.317305 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.317287 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:25:17.319146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.319118 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerStarted","Data":"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98"} Aug 05 17:25:17.319350 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.319331 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:25:17.319411 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.319372 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:25:17.320389 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.320363 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:17.337539 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.337488 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podStartSLOduration=3.428268872 podStartE2EDuration="37.337471955s" totalImagesPullingTime="30.210074551s" totalInitContainerRuntime="3.699128532s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:17.334870004 +0000 UTC m=+779.494797597" watchObservedRunningTime="2026-08-05 17:25:17.337471955 +0000 UTC m=+779.497399546" Aug 05 17:25:17.355230 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.355190 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podStartSLOduration=3.324466245 podStartE2EDuration="36.355178302s" totalImagesPullingTime="29.199076192s" totalInitContainerRuntime="3.831635865s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:17.353841472 +0000 UTC m=+779.513769063" watchObservedRunningTime="2026-08-05 17:25:17.355178302 +0000 UTC m=+779.515105893" Aug 05 17:25:17.375377 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:17.375338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podStartSLOduration=2.394478129 podStartE2EDuration="36.375326502s" totalImagesPullingTime="30.18904506s" totalInitContainerRuntime="3.791803313s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:24:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:25:17.374838511 +0000 UTC m=+779.534766102" watchObservedRunningTime="2026-08-05 17:25:17.375326502 +0000 UTC m=+779.535254093" Aug 05 17:25:18.324426 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:18.324385 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:18.324426 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:18.324402 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:18.324938 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:18.324740 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:25:18.325800 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:18.325778 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:25:19.328213 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:19.328165 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:25:23.328895 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:23.328865 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:25:23.329359 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:23.329342 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:25:23.329452 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:23.329423 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:23.329767 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:23.329742 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:24.333614 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:24.333579 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:25:24.334394 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:24.334351 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:25:33.329705 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:33.329668 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:33.330083 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:33.329814 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:34.334818 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:34.334775 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:25:43.330257 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:43.330174 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:43.330730 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:43.330175 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:44.335018 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:44.334979 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:25:53.330069 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:53.330024 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:25:53.330452 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:53.330024 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:25:54.335116 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:25:54.335065 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:26:00.907004 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:00.906965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:02.067623 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:02.067546 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:03.329621 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:03.329566 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:26:03.330065 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:03.329736 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:26:04.334395 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:04.334353 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:26:11.022460 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.022429 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.123288 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.123246 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.273373 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.273279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.362001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.361962 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.437150 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.437115 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.546201 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.546128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:11.745218 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:11.745184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:26:13.329761 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:13.329727 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:26:13.330298 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:13.330280 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:26:14.334389 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:14.334352 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:26:23.329969 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:23.329922 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:26:24.334880 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:24.334844 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:26:33.330471 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:33.330442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:26:34.321579 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:26:34.321553 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:27:00.927707 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:00.927670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:01.029197 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:01.029139 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.045872 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.045789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.160746 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.160714 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:27:11.160961 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.160937 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" containerID="cri-o://59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7" gracePeriod=30 Aug 05 17:27:11.161021 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.160971 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kube-rbac-proxy" containerID="cri-o://d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1" gracePeriod=30 Aug 05 17:27:11.179289 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.179254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.224749 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.224713 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:27:11.225018 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.224993 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" containerID="cri-o://52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8" gracePeriod=30 Aug 05 17:27:11.225100 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.225035 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kube-rbac-proxy" containerID="cri-o://9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7" gracePeriod=30 Aug 05 17:27:11.272412 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.272379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.290569 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.290541 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:27:11.290798 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.290777 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" containerID="cri-o://f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454" gracePeriod=30 Aug 05 17:27:11.290881 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.290814 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kube-rbac-proxy" containerID="cri-o://0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98" gracePeriod=30 Aug 05 17:27:11.366910 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.366872 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.460943 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.460898 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.558933 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.558848 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.660624 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.660595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:11.786378 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.786343 2558 generic.go:356] "Generic (PLEG): container finished" podID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerID="9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7" exitCode=2 Aug 05 17:27:11.786556 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.786421 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerDied","Data":"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7"} Aug 05 17:27:11.788356 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.788335 2558 generic.go:356] "Generic (PLEG): container finished" podID="74e14104-9c4f-456c-966a-68b55168dc02" containerID="d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1" exitCode=2 Aug 05 17:27:11.788471 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.788405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerDied","Data":"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1"} Aug 05 17:27:11.790319 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.790300 2558 generic.go:356] "Generic (PLEG): container finished" podID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerID="0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98" exitCode=2 Aug 05 17:27:11.790400 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:11.790356 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerDied","Data":"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98"} Aug 05 17:27:12.059877 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:12.059841 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:27:13.325015 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:13.324980 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.23:8643/healthz\": dial tcp 10.132.0.23:8643: connect: connection refused" Aug 05 17:27:13.325410 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:13.324981 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.24:8643/healthz\": dial tcp 10.132.0.24:8643: connect: connection refused" Aug 05 17:27:13.329947 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:13.329917 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.24:8080: connect: connection refused" Aug 05 17:27:13.329947 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:13.329924 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.23:8080: connect: connection refused" Aug 05 17:27:14.317921 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:14.317881 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.25:8080: connect: connection refused" Aug 05 17:27:14.329251 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:14.329215 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.25:8643/healthz\": dial tcp 10.132.0.25:8643: connect: connection refused" Aug 05 17:27:15.127998 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.127971 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:27:15.193331 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193240 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbpxs\" (UniqueName: \"kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs\") pod \"618885d9-612d-4e62-8742-7ce9bf9e7224\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " Aug 05 17:27:15.193331 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193311 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config\") pod \"618885d9-612d-4e62-8742-7ce9bf9e7224\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " Aug 05 17:27:15.193538 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193341 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert\") pod \"618885d9-612d-4e62-8742-7ce9bf9e7224\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " Aug 05 17:27:15.193538 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193389 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location\") pod \"618885d9-612d-4e62-8742-7ce9bf9e7224\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " Aug 05 17:27:15.193538 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193456 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls\") pod \"618885d9-612d-4e62-8742-7ce9bf9e7224\" (UID: \"618885d9-612d-4e62-8742-7ce9bf9e7224\") " Aug 05 17:27:15.193748 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193719 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "618885d9-612d-4e62-8742-7ce9bf9e7224" (UID: "618885d9-612d-4e62-8742-7ce9bf9e7224"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:15.193807 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193773 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "618885d9-612d-4e62-8742-7ce9bf9e7224" (UID: "618885d9-612d-4e62-8742-7ce9bf9e7224"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:15.193855 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.193799 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "618885d9-612d-4e62-8742-7ce9bf9e7224" (UID: "618885d9-612d-4e62-8742-7ce9bf9e7224"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:27:15.195522 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.195502 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs" (OuterVolumeSpecName: "kube-api-access-dbpxs") pod "618885d9-612d-4e62-8742-7ce9bf9e7224" (UID: "618885d9-612d-4e62-8742-7ce9bf9e7224"). InnerVolumeSpecName "kube-api-access-dbpxs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:27:15.195577 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.195555 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "618885d9-612d-4e62-8742-7ce9bf9e7224" (UID: "618885d9-612d-4e62-8742-7ce9bf9e7224"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:15.294710 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.294673 2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/618885d9-612d-4e62-8742-7ce9bf9e7224-proxy-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:15.294710 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.294703 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbpxs\" (UniqueName: \"kubernetes.io/projected/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-api-access-dbpxs\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:15.294710 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.294712 2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:15.294710 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.294721 2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/618885d9-612d-4e62-8742-7ce9bf9e7224-cabundle-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:15.294972 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.294729 2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/618885d9-612d-4e62-8742-7ce9bf9e7224-kserve-provision-location\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:15.808556 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.808516 2558 generic.go:356] "Generic (PLEG): container finished" podID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerID="f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454" exitCode=0 Aug 05 17:27:15.808989 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.808577 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" Aug 05 17:27:15.808989 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.808594 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerDied","Data":"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454"} Aug 05 17:27:15.808989 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.808669 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x" event={"ID":"618885d9-612d-4e62-8742-7ce9bf9e7224","Type":"ContainerDied","Data":"0b54fd9d29d9664d59dccdad216e92d23c0d09b6af95d93ba91c56b8c802d8a2"} Aug 05 17:27:15.808989 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.808696 2558 scope.go:117] "RemoveContainer" containerID="0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98" Aug 05 17:27:15.817295 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.817276 2558 scope.go:117] "RemoveContainer" containerID="f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454" Aug 05 17:27:15.824683 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.824664 2558 scope.go:117] "RemoveContainer" containerID="72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b" Aug 05 17:27:15.830616 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.830593 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:27:15.834335 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.833576 2558 scope.go:117] "RemoveContainer" containerID="0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98" Aug 05 17:27:15.834755 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:15.834735 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98\": container with ID starting with 0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98 not found: ID does not exist" containerID="0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98" Aug 05 17:27:15.834852 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.834763 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98"} err="failed to get container status \"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98\": rpc error: code = NotFound desc = could not find container \"0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98\": container with ID starting with 0101143ab569599d01b973adb85588fc757e14782f87ed807f7a228d81940b98 not found: ID does not exist" Aug 05 17:27:15.834852 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.834784 2558 scope.go:117] "RemoveContainer" containerID="f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454" Aug 05 17:27:15.835001 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.834980 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-dxz4x"] Aug 05 17:27:15.835079 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:15.835057 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454\": container with ID starting with f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454 not found: ID does not exist" containerID="f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454" Aug 05 17:27:15.835135 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.835088 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454"} err="failed to get container status \"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454\": rpc error: code = NotFound desc = could not find container \"f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454\": container with ID starting with f8a196970aaab962d7449708b38de2497e5097f4e22f9271f09659f2b02d3454 not found: ID does not exist" Aug 05 17:27:15.835135 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.835109 2558 scope.go:117] "RemoveContainer" containerID="72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b" Aug 05 17:27:15.835409 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:15.835390 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b\": container with ID starting with 72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b not found: ID does not exist" containerID="72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b" Aug 05 17:27:15.835473 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:15.835415 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b"} err="failed to get container status \"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b\": rpc error: code = NotFound desc = could not find container \"72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b\": container with ID starting with 72bcc694241ea802bfdd929c35e670a3230cbfac5f1bfd74dd976974f2ded33b not found: ID does not exist" Aug 05 17:27:16.283395 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.283372 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:27:16.285788 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.285768 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:27:16.322822 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.322785 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" path="/var/lib/kubelet/pods/618885d9-612d-4e62-8742-7ce9bf9e7224/volumes" Aug 05 17:27:16.403099 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403070 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert\") pod \"74e14104-9c4f-456c-966a-68b55168dc02\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " Aug 05 17:27:16.403281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403108 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location\") pod \"74e14104-9c4f-456c-966a-68b55168dc02\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " Aug 05 17:27:16.403281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403140 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5fjn\" (UniqueName: \"kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn\") pod \"f6659c94-e049-40d7-a9a2-fbd59847eff6\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " Aug 05 17:27:16.403281 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403167 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert\") pod \"f6659c94-e049-40d7-a9a2-fbd59847eff6\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " Aug 05 17:27:16.403449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403286 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config\") pod \"f6659c94-e049-40d7-a9a2-fbd59847eff6\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " Aug 05 17:27:16.403449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403326 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls\") pod \"f6659c94-e049-40d7-a9a2-fbd59847eff6\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " Aug 05 17:27:16.403449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403385 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location\") pod \"f6659c94-e049-40d7-a9a2-fbd59847eff6\" (UID: \"f6659c94-e049-40d7-a9a2-fbd59847eff6\") " Aug 05 17:27:16.403449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403421 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7r7x\" (UniqueName: \"kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x\") pod \"74e14104-9c4f-456c-966a-68b55168dc02\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " Aug 05 17:27:16.403449 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403448 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config\") pod \"74e14104-9c4f-456c-966a-68b55168dc02\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " Aug 05 17:27:16.403715 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403448 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "74e14104-9c4f-456c-966a-68b55168dc02" (UID: "74e14104-9c4f-456c-966a-68b55168dc02"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:27:16.403715 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403474 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") pod \"74e14104-9c4f-456c-966a-68b55168dc02\" (UID: \"74e14104-9c4f-456c-966a-68b55168dc02\") " Aug 05 17:27:16.403715 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403579 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "74e14104-9c4f-456c-966a-68b55168dc02" (UID: "74e14104-9c4f-456c-966a-68b55168dc02"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:16.403715 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403595 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "f6659c94-e049-40d7-a9a2-fbd59847eff6" (UID: "f6659c94-e049-40d7-a9a2-fbd59847eff6"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:16.403909 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403723 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "f6659c94-e049-40d7-a9a2-fbd59847eff6" (UID: "f6659c94-e049-40d7-a9a2-fbd59847eff6"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:16.403909 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403788 2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-cabundle-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.403909 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403812 2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/74e14104-9c4f-456c-966a-68b55168dc02-kserve-provision-location\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.403909 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403826 2558 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-cabundle-cert\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.404085 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403953 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "74e14104-9c4f-456c-966a-68b55168dc02" (UID: "74e14104-9c4f-456c-966a-68b55168dc02"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 05 17:27:16.404085 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.403997 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "f6659c94-e049-40d7-a9a2-fbd59847eff6" (UID: "f6659c94-e049-40d7-a9a2-fbd59847eff6"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 17:27:16.405440 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.405408 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn" (OuterVolumeSpecName: "kube-api-access-d5fjn") pod "f6659c94-e049-40d7-a9a2-fbd59847eff6" (UID: "f6659c94-e049-40d7-a9a2-fbd59847eff6"). InnerVolumeSpecName "kube-api-access-d5fjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:27:16.405543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.405444 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "74e14104-9c4f-456c-966a-68b55168dc02" (UID: "74e14104-9c4f-456c-966a-68b55168dc02"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:16.405543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.405467 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f6659c94-e049-40d7-a9a2-fbd59847eff6" (UID: "f6659c94-e049-40d7-a9a2-fbd59847eff6"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 05 17:27:16.405543 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.405511 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x" (OuterVolumeSpecName: "kube-api-access-h7r7x") pod "74e14104-9c4f-456c-966a-68b55168dc02" (UID: "74e14104-9c4f-456c-966a-68b55168dc02"). InnerVolumeSpecName "kube-api-access-h7r7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 17:27:16.504995 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.504953 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7r7x\" (UniqueName: \"kubernetes.io/projected/74e14104-9c4f-456c-966a-68b55168dc02-kube-api-access-h7r7x\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.504995 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.504989 2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/74e14104-9c4f-456c-966a-68b55168dc02-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.504995 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.505002 2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74e14104-9c4f-456c-966a-68b55168dc02-proxy-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.505236 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.505016 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5fjn\" (UniqueName: \"kubernetes.io/projected/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-api-access-d5fjn\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.505236 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.505029 2558 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/f6659c94-e049-40d7-a9a2-fbd59847eff6-kube-rbac-proxy-sar-config\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.505236 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.505042 2558 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f6659c94-e049-40d7-a9a2-fbd59847eff6-proxy-tls\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.505236 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.505054 2558 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f6659c94-e049-40d7-a9a2-fbd59847eff6-kserve-provision-location\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 17:27:16.815680 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.815578 2558 generic.go:356] "Generic (PLEG): container finished" podID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerID="52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8" exitCode=0 Aug 05 17:27:16.815680 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.815660 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" Aug 05 17:27:16.815680 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.815662 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerDied","Data":"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8"} Aug 05 17:27:16.816219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.815755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc" event={"ID":"f6659c94-e049-40d7-a9a2-fbd59847eff6","Type":"ContainerDied","Data":"15adfd859ff3a2c285d4ba34652720809adcc148ccfda87802fd3d01af9df389"} Aug 05 17:27:16.816219 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.815784 2558 scope.go:117] "RemoveContainer" containerID="9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7" Aug 05 17:27:16.817548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.817522 2558 generic.go:356] "Generic (PLEG): container finished" podID="74e14104-9c4f-456c-966a-68b55168dc02" containerID="59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7" exitCode=0 Aug 05 17:27:16.817688 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.817570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerDied","Data":"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7"} Aug 05 17:27:16.817688 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.817592 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" Aug 05 17:27:16.817688 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.817620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c" event={"ID":"74e14104-9c4f-456c-966a-68b55168dc02","Type":"ContainerDied","Data":"f718cefc8aec9d2daa2f8c0140a4f369ae2bf1867008ba9b2655b5b4e3813744"} Aug 05 17:27:16.824614 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.824590 2558 scope.go:117] "RemoveContainer" containerID="52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8" Aug 05 17:27:16.831845 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.831825 2558 scope.go:117] "RemoveContainer" containerID="4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0" Aug 05 17:27:16.839227 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839210 2558 scope.go:117] "RemoveContainer" containerID="9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7" Aug 05 17:27:16.839504 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.839484 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7\": container with ID starting with 9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7 not found: ID does not exist" containerID="9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7" Aug 05 17:27:16.839574 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839515 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7"} err="failed to get container status \"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7\": rpc error: code = NotFound desc = could not find container \"9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7\": container with ID starting with 9d5c893bc2c94492d77e2a7b7348cb8e8c0011ad06d73c8dc77428bfc62e9ad7 not found: ID does not exist" Aug 05 17:27:16.839574 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839538 2558 scope.go:117] "RemoveContainer" containerID="52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8" Aug 05 17:27:16.839758 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839741 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:27:16.839815 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.839765 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8\": container with ID starting with 52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8 not found: ID does not exist" containerID="52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8" Aug 05 17:27:16.839815 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839799 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8"} err="failed to get container status \"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8\": rpc error: code = NotFound desc = could not find container \"52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8\": container with ID starting with 52a6db84c3a5fd3cf201193363eea98c62d9e99137c71b11f87af431cb213ed8 not found: ID does not exist" Aug 05 17:27:16.839906 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.839819 2558 scope.go:117] "RemoveContainer" containerID="4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0" Aug 05 17:27:16.840067 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.840050 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0\": container with ID starting with 4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0 not found: ID does not exist" containerID="4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0" Aug 05 17:27:16.840113 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.840071 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0"} err="failed to get container status \"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0\": rpc error: code = NotFound desc = could not find container \"4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0\": container with ID starting with 4bae737c04cc2393f59a146d88985106bedfbad59596aeaeb677d13e928d2cf0 not found: ID does not exist" Aug 05 17:27:16.840113 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.840086 2558 scope.go:117] "RemoveContainer" containerID="d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1" Aug 05 17:27:16.842676 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.842653 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-69ddc59866-6f2nc"] Aug 05 17:27:16.847785 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.847766 2558 scope.go:117] "RemoveContainer" containerID="59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7" Aug 05 17:27:16.853313 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.853288 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:27:16.855170 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.855155 2558 scope.go:117] "RemoveContainer" containerID="97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e" Aug 05 17:27:16.857474 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.857457 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-756656f574-kg87c"] Aug 05 17:27:16.862279 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.862263 2558 scope.go:117] "RemoveContainer" containerID="d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1" Aug 05 17:27:16.862529 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.862513 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1\": container with ID starting with d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1 not found: ID does not exist" containerID="d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1" Aug 05 17:27:16.862572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.862534 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1"} err="failed to get container status \"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1\": rpc error: code = NotFound desc = could not find container \"d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1\": container with ID starting with d919054585904c806b6e507c72c87473440ce2889eebd2e65e38e87075ab1cd1 not found: ID does not exist" Aug 05 17:27:16.862572 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.862553 2558 scope.go:117] "RemoveContainer" containerID="59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7" Aug 05 17:27:16.862780 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.862762 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7\": container with ID starting with 59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7 not found: ID does not exist" containerID="59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7" Aug 05 17:27:16.862828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.862788 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7"} err="failed to get container status \"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7\": rpc error: code = NotFound desc = could not find container \"59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7\": container with ID starting with 59f27e5566adf3822643129db45096dc06b18bbf61da0b78a0ac3ad8a00b98c7 not found: ID does not exist" Aug 05 17:27:16.862828 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.862803 2558 scope.go:117] "RemoveContainer" containerID="97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e" Aug 05 17:27:16.863037 ip-10-0-135-121 kubenswrapper[2558]: E0805 17:27:16.863019 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e\": container with ID starting with 97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e not found: ID does not exist" containerID="97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e" Aug 05 17:27:16.863075 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:16.863042 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e"} err="failed to get container status \"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e\": rpc error: code = NotFound desc = could not find container \"97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e\": container with ID starting with 97d9e0c962688e615539c5448f9d40d5fd5efeaa4cb9c5367ae293c02891cc7e not found: ID does not exist" Aug 05 17:27:18.321939 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.321898 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:27:18.322371 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.321910 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:27:18.323644 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.323599 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e14104-9c4f-456c-966a-68b55168dc02" path="/var/lib/kubelet/pods/74e14104-9c4f-456c-966a-68b55168dc02/volumes" Aug 05 17:27:18.324271 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.324251 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" path="/var/lib/kubelet/pods/f6659c94-e049-40d7-a9a2-fbd59847eff6/volumes" Aug 05 17:27:18.328225 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.328205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:27:18.328319 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:18.328205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:27:33.119062 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:27:33.119031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:11.262488 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:28:11.262450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:11.356665 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:28:11.356618 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:12.560303 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:28:12.560272 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:46.377130 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:28:46.377047 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:28:46.438511 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:28:46.438473 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:52.358047 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:29:52.358012 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:29:52.422237 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:29:52.422200 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:32:18.345458 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:32:18.345430 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:32:18.346732 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:32:18.346704 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:32:18.351443 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:32:18.351428 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:32:18.352650 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:32:18.352616 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:32:54.726160 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:32:54.726120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.018873 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.018820 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.148690 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.148653 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.243466 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.243426 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.339147 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.339041 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.431818 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.431784 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:26.904166 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:26.904128 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:35:29.045733 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:35:29.045675 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:25.967825 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:25.967748 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.091975 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.091937 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.183980 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.183950 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.280263 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.280182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.394919 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.394892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.483488 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.483461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:26.585242 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:26.585174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:36.330893 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:36.330818 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:36.458896 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:36.458862 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:36.557225 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:36.557176 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:36.676751 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:36.676720 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:36.772216 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:36.772184 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:36:37.019190 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:36:37.019112 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:18.374438 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:18.374409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:37:18.376389 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:18.376361 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:37:18.380331 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:18.380309 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:37:18.382237 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:18.382219 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:37:26.195074 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:26.195036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:26.406342 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:26.406310 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:36.318419 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:36.318322 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:36.545820 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:36.545790 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:36.633592 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:36.633560 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:36.720334 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:36.720303 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:36.871998 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:36.871965 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:37.267817 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:37.267786 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:37:41.607450 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:37:41.607354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:38:36.577551 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:38:36.577513 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:38:38.034015 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:38:38.033978 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:42:18.397382 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:42:18.397353 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:42:18.400384 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:42:18.400364 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:42:18.403695 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:42:18.403675 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:42:18.406332 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:42:18.406314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:44:59.401879 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:44:59.401837 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:51.146399 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:51.146316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:51.293792 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:51.293761 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:51.379145 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:51.379120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:51.456871 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:51.456799 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:51.556844 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:51.556813 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:45:52.008960 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:45:52.008936 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.137204 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.137107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.253173 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.253143 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.337201 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.337164 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.419108 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.419028 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.516041 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.516009 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.615882 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.615852 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:46:51.925646 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:46:51.925614 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:01.443903 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:01.443870 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:01.613058 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:01.613033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:01.697747 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:01.697665 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:01.778404 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:01.778376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:02.087243 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:02.087170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:02.186881 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:02.186860 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:47:18.427184 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:18.427157 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:47:18.430196 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:18.430169 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:47:18.433100 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:18.433081 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:47:18.436057 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:47:18.436042 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:48:01.448256 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:48:01.448221 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:48:01.532929 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:48:01.532900 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:48:01.708556 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:48:01.708446 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:48:01.960714 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:48:01.960628 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:49:05.522011 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:49:05.521961 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:49:39.088361 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:49:39.088324 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:51:12.017018 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:51:12.016921 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:51:19.784682 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:51:19.784645 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:52:18.451169 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:52:18.451064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:52:18.455146 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:52:18.454290 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:52:18.457269 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:52:18.457251 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:52:18.460547 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:52:18.460533 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:54:32.001548 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:54:32.001461 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:54:43.136157 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:54:43.136123 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:56:16.389971 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:56:16.389938 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:56:17.678718 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:56:17.678681 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:57:18.479049 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:57:18.478933 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:57:18.482867 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:57:18.481206 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 17:57:18.484648 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:57:18.484616 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:57:18.487083 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:57:18.487066 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 17:57:18.921456 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:57:18.921427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 17:59:54.649352 ip-10-0-135-121 kubenswrapper[2558]: I0805 17:59:54.649314 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:02:18.501699 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:02:18.501578 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 18:02:18.506101 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:02:18.504840 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 18:02:18.507592 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:02:18.507575 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 18:02:18.510811 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:02:18.510795 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 18:04:20.650392 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:20.650354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:21.489755 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.489720 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtrhl/must-gather-8x4lv"] Aug 05 18:04:21.490006 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.489995 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="storage-initializer" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490007 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="storage-initializer" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490016 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490022 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490028 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490033 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490043 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" Aug 05 18:04:21.490050 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490048 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490057 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490062 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490071 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490076 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490088 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="storage-initializer" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490092 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="storage-initializer" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490100 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490105 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490115 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="storage-initializer" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490121 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="storage-initializer" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490168 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490175 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490182 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kube-rbac-proxy" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490198 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="618885d9-612d-4e62-8742-7ce9bf9e7224" containerName="kserve-container" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490204 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6659c94-e049-40d7-a9a2-fbd59847eff6" containerName="kserve-container" Aug 05 18:04:21.490293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.490210 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e14104-9c4f-456c-966a-68b55168dc02" containerName="kserve-container" Aug 05 18:04:21.493219 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.493204 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.495518 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.495491 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtrhl\"/\"openshift-service-ca.crt\"" Aug 05 18:04:21.496612 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.496596 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vtrhl\"/\"default-dockercfg-n5jhq\"" Aug 05 18:04:21.496709 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.496689 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtrhl\"/\"kube-root-ca.crt\"" Aug 05 18:04:21.500714 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.500693 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtrhl/must-gather-8x4lv"] Aug 05 18:04:21.608710 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.608676 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cz7t\" (UniqueName: \"kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.608889 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.608738 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.709237 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.709197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cz7t\" (UniqueName: \"kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.709664 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.709253 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.709664 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.709536 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.716727 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.716709 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cz7t\" (UniqueName: \"kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t\") pod \"must-gather-8x4lv\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.807971 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.807887 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:21.929782 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.929760 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtrhl/must-gather-8x4lv"] Aug 05 18:04:21.932344 ip-10-0-135-121 kubenswrapper[2558]: W0805 18:04:21.932310 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12e363ed_6531_4b92_ae93_737d1666297b.slice/crio-59bda327780419a6c10e9715bc986d7b0ee0614603092168b6df4f3115239a86 WatchSource:0}: Error finding container 59bda327780419a6c10e9715bc986d7b0ee0614603092168b6df4f3115239a86: Status 404 returned error can't find the container with id 59bda327780419a6c10e9715bc986d7b0ee0614603092168b6df4f3115239a86 Aug 05 18:04:21.934159 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:21.934139 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 05 18:04:22.042027 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:22.041995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" event={"ID":"12e363ed-6531-4b92-ae93-737d1666297b","Type":"ContainerStarted","Data":"59bda327780419a6c10e9715bc986d7b0ee0614603092168b6df4f3115239a86"} Aug 05 18:04:22.455506 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:22.455475 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:28.077810 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:28.077742 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" event={"ID":"12e363ed-6531-4b92-ae93-737d1666297b","Type":"ContainerStarted","Data":"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd"} Aug 05 18:04:29.083082 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:29.083048 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" event={"ID":"12e363ed-6531-4b92-ae93-737d1666297b","Type":"ContainerStarted","Data":"721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587"} Aug 05 18:04:29.099690 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:29.099619 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" podStartSLOduration=2.1073675 podStartE2EDuration="8.099603189s" totalImagesPullingTime="5.992235689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 18:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:04:29.097890428 +0000 UTC m=+3131.257818019" watchObservedRunningTime="2026-08-05 18:04:29.099603189 +0000 UTC m=+3131.259530780" Aug 05 18:04:48.164797 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:48.164762 2558 generic.go:356] "Generic (PLEG): container finished" podID="12e363ed-6531-4b92-ae93-737d1666297b" containerID="96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd" exitCode=0 Aug 05 18:04:48.165212 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:48.164824 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" event={"ID":"12e363ed-6531-4b92-ae93-737d1666297b","Type":"ContainerDied","Data":"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd"} Aug 05 18:04:48.165212 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:48.165171 2558 scope.go:117] "RemoveContainer" containerID="96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd" Aug 05 18:04:48.372643 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:48.372606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vtrhl_must-gather-8x4lv_12e363ed-6531-4b92-ae93-737d1666297b/gather/0.log" Aug 05 18:04:49.236795 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:49.236759 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:49.294780 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:49.294752 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:51.644343 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:51.644310 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-njb6v_9678ee84-e4aa-4eae-bdbf-9e294941d737/global-pull-secret-syncer/0.log" Aug 05 18:04:51.695037 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:51.695008 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" Aug 05 18:04:51.792145 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:51.792108 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-121.ec2.internal_dc138473677e6ba7951298e1c98d8360/haproxy/0.log" Aug 05 18:04:53.812790 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:53.812755 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-vtrhl/must-gather-8x4lv"] Aug 05 18:04:53.813172 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:53.812926 2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="copy" containerID="cri-o://721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587" gracePeriod=2 Aug 05 18:04:53.815199 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:53.815165 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8x4lv\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vtrhl\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="12e363ed-6531-4b92-ae93-737d1666297b" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:53.816698 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:53.816651 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-vtrhl/must-gather-8x4lv"] Aug 05 18:04:54.034579 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.034558 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vtrhl_must-gather-8x4lv_12e363ed-6531-4b92-ae93-737d1666297b/copy/0.log" Aug 05 18:04:54.036094 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.036078 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:54.038242 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:54.038221 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8x4lv\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vtrhl\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="12e363ed-6531-4b92-ae93-737d1666297b" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:54.089170 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.089098 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output\") pod \"12e363ed-6531-4b92-ae93-737d1666297b\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " Aug 05 18:04:54.089293 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.089198 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cz7t\" (UniqueName: \"kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t\") pod \"12e363ed-6531-4b92-ae93-737d1666297b\" (UID: \"12e363ed-6531-4b92-ae93-737d1666297b\") " Aug 05 18:04:54.090720 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.090693 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "12e363ed-6531-4b92-ae93-737d1666297b" (UID: "12e363ed-6531-4b92-ae93-737d1666297b"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 05 18:04:54.091209 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.091181 2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t" (OuterVolumeSpecName: "kube-api-access-4cz7t") pod "12e363ed-6531-4b92-ae93-737d1666297b" (UID: "12e363ed-6531-4b92-ae93-737d1666297b"). InnerVolumeSpecName "kube-api-access-4cz7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 05 18:04:54.188184 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.188160 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-vtrhl_must-gather-8x4lv_12e363ed-6531-4b92-ae93-737d1666297b/copy/0.log" Aug 05 18:04:54.188510 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.188490 2558 generic.go:356] "Generic (PLEG): container finished" podID="12e363ed-6531-4b92-ae93-737d1666297b" containerID="721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587" exitCode=143 Aug 05 18:04:54.188574 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.188534 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:54.188623 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.188601 2558 scope.go:117] "RemoveContainer" containerID="721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587" Aug 05 18:04:54.189720 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.189698 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cz7t\" (UniqueName: \"kubernetes.io/projected/12e363ed-6531-4b92-ae93-737d1666297b-kube-api-access-4cz7t\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 18:04:54.189784 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.189727 2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/12e363ed-6531-4b92-ae93-737d1666297b-must-gather-output\") on node \"ip-10-0-135-121.ec2.internal\" DevicePath \"\"" Aug 05 18:04:54.190821 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:54.190798 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8x4lv\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vtrhl\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="12e363ed-6531-4b92-ae93-737d1666297b" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:54.196091 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.196072 2558 scope.go:117] "RemoveContainer" containerID="96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd" Aug 05 18:04:54.197785 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:54.197763 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8x4lv\" is forbidden: User \"system:node:ip-10-0-135-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-vtrhl\": no relationship found between node 'ip-10-0-135-121.ec2.internal' and this object" podUID="12e363ed-6531-4b92-ae93-737d1666297b" pod="openshift-must-gather-vtrhl/must-gather-8x4lv" Aug 05 18:04:54.207885 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.207870 2558 scope.go:117] "RemoveContainer" containerID="721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587" Aug 05 18:04:54.208155 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:54.208130 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587\": container with ID starting with 721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587 not found: ID does not exist" containerID="721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587" Aug 05 18:04:54.208241 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.208162 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587"} err="failed to get container status \"721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587\": rpc error: code = NotFound desc = could not find container \"721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587\": container with ID starting with 721ef386bc397776ae13bb523e56ff64012789f2e77eef474360a203de8bc587 not found: ID does not exist" Aug 05 18:04:54.208241 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.208185 2558 scope.go:117] "RemoveContainer" containerID="96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd" Aug 05 18:04:54.208436 ip-10-0-135-121 kubenswrapper[2558]: E0805 18:04:54.208419 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd\": container with ID starting with 96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd not found: ID does not exist" containerID="96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd" Aug 05 18:04:54.208478 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.208440 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd"} err="failed to get container status \"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd\": rpc error: code = NotFound desc = could not find container \"96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd\": container with ID starting with 96497d8c0307a976a24240de214f70f0dc76d85674c210de85f35cb1956a33bd not found: ID does not exist" Aug 05 18:04:54.321157 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.321132 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12e363ed-6531-4b92-ae93-737d1666297b" path="/var/lib/kubelet/pods/12e363ed-6531-4b92-ae93-737d1666297b/volumes" Aug 05 18:04:54.606287 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.606253 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:54.672499 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:54.672464 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:04:56.466681 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.466595 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj8cb_edccba44-31a2-41cc-a7bd-b0f9b9148179/node-exporter/0.log" Aug 05 18:04:56.489787 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.489759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj8cb_edccba44-31a2-41cc-a7bd-b0f9b9148179/kube-rbac-proxy/0.log" Aug 05 18:04:56.512078 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.512061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hj8cb_edccba44-31a2-41cc-a7bd-b0f9b9148179/init-textfile/0.log" Aug 05 18:04:56.540629 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.540609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vvhdt_6c111edd-d5be-4cb2-a35d-fa27c1800ab5/kube-rbac-proxy-main/0.log" Aug 05 18:04:56.563346 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.563327 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vvhdt_6c111edd-d5be-4cb2-a35d-fa27c1800ab5/kube-rbac-proxy-self/0.log" Aug 05 18:04:56.585457 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.585437 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-vvhdt_6c111edd-d5be-4cb2-a35d-fa27c1800ab5/openshift-state-metrics/0.log" Aug 05 18:04:56.620097 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.620077 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/prometheus/0.log" Aug 05 18:04:56.636948 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.636928 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/config-reloader/0.log" Aug 05 18:04:56.657645 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.657609 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/thanos-sidecar/0.log" Aug 05 18:04:56.681629 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.681610 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/kube-rbac-proxy-web/0.log" Aug 05 18:04:56.706223 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.706208 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/kube-rbac-proxy/0.log" Aug 05 18:04:56.725795 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.725740 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/kube-rbac-proxy-thanos/0.log" Aug 05 18:04:56.746544 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.746527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e4268498-5795-4bf9-a777-63e200c1ecdd/init-config-reloader/0.log" Aug 05 18:04:56.777670 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.777648 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-gfttn_bf464e26-718f-442c-8a05-c65e3d830439/prometheus-operator/0.log" Aug 05 18:04:56.796057 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.795992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-gfttn_bf464e26-718f-442c-8a05-c65e3d830439/kube-rbac-proxy/0.log" Aug 05 18:04:56.821064 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:56.821047 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-dvdvb_20f4fdfc-6080-48cd-8b3a-2b0fb5611f0a/prometheus-operator-admission-webhook/0.log" Aug 05 18:04:58.796055 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:58.796024 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/2.log" Aug 05 18:04:58.804233 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:58.804205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-vvxlc_62a008db-636a-4cc2-a080-55a194c06ba9/console-operator/3.log" Aug 05 18:04:59.601677 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601647 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t"] Aug 05 18:04:59.601917 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601906 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="gather" Aug 05 18:04:59.601966 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601919 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="gather" Aug 05 18:04:59.601966 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601930 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="copy" Aug 05 18:04:59.601966 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601936 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="copy" Aug 05 18:04:59.602069 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.601995 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="copy" Aug 05 18:04:59.602069 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.602004 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="12e363ed-6531-4b92-ae93-737d1666297b" containerName="gather" Aug 05 18:04:59.605666 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.605628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.608315 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.608288 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bm58p\"/\"default-dockercfg-q7pnh\"" Aug 05 18:04:59.608417 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.608322 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bm58p\"/\"openshift-service-ca.crt\"" Aug 05 18:04:59.609292 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.609278 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bm58p\"/\"kube-root-ca.crt\"" Aug 05 18:04:59.615023 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.615006 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t"] Aug 05 18:04:59.734191 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.734161 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-sys\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.734333 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.734199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-proc\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.734333 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.734283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jqgd\" (UniqueName: \"kubernetes.io/projected/badf12c7-fd7f-4e3b-aec3-37760836cb44-kube-api-access-9jqgd\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.734333 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.734317 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-podres\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.734438 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.734338 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-lib-modules\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835432 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835405 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jqgd\" (UniqueName: \"kubernetes.io/projected/badf12c7-fd7f-4e3b-aec3-37760836cb44-kube-api-access-9jqgd\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-podres\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835455 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-lib-modules\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835473 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-sys\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-proc\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835571 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-proc\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835576 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-sys\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835594 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-podres\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.835821 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.835594 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/badf12c7-fd7f-4e3b-aec3-37760836cb44-lib-modules\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.843527 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.843504 2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jqgd\" (UniqueName: \"kubernetes.io/projected/badf12c7-fd7f-4e3b-aec3-37760836cb44-kube-api-access-9jqgd\") pod \"perf-node-gather-daemonset-bfd7t\" (UID: \"badf12c7-fd7f-4e3b-aec3-37760836cb44\") " pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:04:59.915459 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:04:59.915439 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:05:00.036225 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.036197 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t"] Aug 05 18:05:00.039581 ip-10-0-135-121 kubenswrapper[2558]: W0805 18:05:00.039551 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbadf12c7_fd7f_4e3b_aec3_37760836cb44.slice/crio-978cf25c074294cca713c8fab88d61b6357e5f9f87cad36188c7d83506c7f121 WatchSource:0}: Error finding container 978cf25c074294cca713c8fab88d61b6357e5f9f87cad36188c7d83506c7f121: Status 404 returned error can't find the container with id 978cf25c074294cca713c8fab88d61b6357e5f9f87cad36188c7d83506c7f121 Aug 05 18:05:00.210849 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.210793 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" event={"ID":"badf12c7-fd7f-4e3b-aec3-37760836cb44","Type":"ContainerStarted","Data":"1243dd711fdb4cb14c932507df79d1d637cd7cec5c2031153be601770c34ffe3"} Aug 05 18:05:00.210849 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.210839 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" event={"ID":"badf12c7-fd7f-4e3b-aec3-37760836cb44","Type":"ContainerStarted","Data":"978cf25c074294cca713c8fab88d61b6357e5f9f87cad36188c7d83506c7f121"} Aug 05 18:05:00.210982 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.210929 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:05:00.226904 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.226858 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" podStartSLOduration=1.226847143 podStartE2EDuration="1.226847143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 18:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 18:05:00.225727235 +0000 UTC m=+3162.385654826" watchObservedRunningTime="2026-08-05 18:05:00.226847143 +0000 UTC m=+3162.386774757" Aug 05 18:05:00.718444 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.718420 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lm8mt_f7caf090-1cf9-453a-abd4-abf713ba136c/dns/0.log" Aug 05 18:05:00.736195 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.736172 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lm8mt_f7caf090-1cf9-453a-abd4-abf713ba136c/kube-rbac-proxy/0.log" Aug 05 18:05:00.757016 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:00.756998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b6fj4_27f3a2bb-ebfe-4fd8-aa0a-63c9f5fdbe83/dns-node-resolver/0.log" Aug 05 18:05:01.318013 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:01.317989 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcnpm_d65e80cc-6d3d-4b57-9489-dec130c43c54/node-ca/0.log" Aug 05 18:05:02.052584 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.052553 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d966c8946-tf75k_ecdd68f3-c841-4fdb-b6a2-adbd342849fb/router/0.log" Aug 05 18:05:02.355753 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.355676 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-79gsb_364c8073-052c-488d-ba47-72bd1eeb97ab/serve-healthcheck-canary/0.log" Aug 05 18:05:02.719896 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.719864 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-svfhd_82b231cc-138d-4c1f-9d33-769d16907f7e/insights-operator/0.log" Aug 05 18:05:02.721062 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.721040 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-svfhd_82b231cc-138d-4c1f-9d33-769d16907f7e/insights-operator/1.log" Aug 05 18:05:02.800266 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.800243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrgfv_11817afc-64ad-43fc-9bf6-e6552b52f0b8/kube-rbac-proxy/0.log" Aug 05 18:05:02.818167 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.818144 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrgfv_11817afc-64ad-43fc-9bf6-e6552b52f0b8/exporter/0.log" Aug 05 18:05:02.837019 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:02.836988 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrgfv_11817afc-64ad-43fc-9bf6-e6552b52f0b8/extractor/0.log" Aug 05 18:05:05.215030 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:05.215003 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-wj8vk_de77d659-2b3e-45b7-ac0c-a038abbc3c2b/s3-init/0.log" Aug 05 18:05:05.229423 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:05.229396 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-wj8vk_de77d659-2b3e-45b7-ac0c-a038abbc3c2b/download-hf-model/0.log" Aug 05 18:05:06.223312 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:06.223283 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bm58p/perf-node-gather-daemonset-bfd7t" Aug 05 18:05:07.799225 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:07.799192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9zv7z_0cbb17e7-0039-49af-b9e9-de1976b5074a/konnectivity-agent/0.log" limit=1024 Aug 05 18:05:09.425289 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:09.425249 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-zbvs5_c82f7016-607a-4d26-8fd7-21544c402ed5/kube-storage-version-migrator-operator/1.log" Aug 05 18:05:09.426852 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:09.426810 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-zbvs5_c82f7016-607a-4d26-8fd7-21544c402ed5/kube-storage-version-migrator-operator/0.log" Aug 05 18:05:10.596228 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.596204 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/kube-multus-additional-cni-plugins/0.log" Aug 05 18:05:10.616901 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.616880 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/egress-router-binary-copy/0.log" Aug 05 18:05:10.636183 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.636163 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/cni-plugins/0.log" Aug 05 18:05:10.655125 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.655105 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/bond-cni-plugin/0.log" Aug 05 18:05:10.673468 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.673450 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/routeoverride-cni/0.log" Aug 05 18:05:10.692423 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.692405 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/whereabouts-cni-bincopy/0.log" Aug 05 18:05:10.711409 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.711389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prjht_ef88c51e-70ff-4dbc-83d4-e7acf95501e4/whereabouts-cni/0.log" Aug 05 18:05:10.741763 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.741743 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ff7z8_a3bef19f-18f2-4143-8d2f-500712b42ab4/kube-multus/0.log" Aug 05 18:05:10.857073 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.857006 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lps6b_da13f392-8652-4de4-a260-9fb0c690bf43/network-metrics-daemon/0.log" Aug 05 18:05:10.875472 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:10.875451 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lps6b_da13f392-8652-4de4-a260-9fb0c690bf43/kube-rbac-proxy/0.log" Aug 05 18:05:11.794121 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.794091 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-controller/0.log" Aug 05 18:05:11.810879 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.810857 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/1.log" Aug 05 18:05:11.811019 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.810858 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovn-acl-logging/0.log" Aug 05 18:05:11.830402 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.830363 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/kube-rbac-proxy-node/0.log" Aug 05 18:05:11.850781 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.850757 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/kube-rbac-proxy-ovn-metrics/0.log" Aug 05 18:05:11.865388 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.865367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/northd/0.log" Aug 05 18:05:11.882465 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.882443 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/nbdb/0.log" Aug 05 18:05:11.900180 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.900161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/sbdb/0.log" Aug 05 18:05:11.953467 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:11.953442 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rd856_2a74dbb3-fb47-4433-b0e0-3e29afa5a303/ovnkube-controller/0.log" Aug 05 18:05:13.095393 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:13.095366 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wxz44_d6cae1ea-352a-4289-9337-210a0a10178d/network-check-target-container/0.log" Aug 05 18:05:13.961084 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:13.961036 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-mcz29_9eec4881-9cad-427f-85f8-64005aa4d0cd/iptables-alerter/0.log" Aug 05 18:05:14.588531 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:14.588496 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8xzc8_5c7cb1c9-a10b-4acc-92c8-e0d7c524d5db/tuned/0.log" Aug 05 18:05:16.317396 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:16.317361 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-dvsk9_4b686f12-35df-4873-9087-f541b054999e/cluster-samples-operator/0.log" Aug 05 18:05:16.333069 ip-10-0-135-121 kubenswrapper[2558]: I0805 18:05:16.333044 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-559cbf5745-dvsk9_4b686f12-35df-4873-9087-f541b054999e/cluster-samples-operator-watch/0.log"