Jul 08 15:57:20.338697 ip-10-0-133-83 systemd[1]: Starting Kubernetes Kubelet... Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.828263 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834758 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834772 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834777 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834782 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834787 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834791 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834795 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:20.843441 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834799 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834804 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834808 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834812 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834816 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834820 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834824 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834827 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834832 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834835 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834839 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834843 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834847 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834851 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834854 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834858 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834861 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834865 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834869 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834873 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.033719 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834877 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:20.915109 ip-10-0-133-83 systemd[1]: Started Kubernetes Kubelet. Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834881 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834884 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834889 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834894 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834899 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834903 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834907 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834911 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834915 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834918 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834922 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834926 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834930 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834933 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834937 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834941 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834944 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834949 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.035138 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834952 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834956 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834963 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834969 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834974 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834978 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834982 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834985 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834989 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834992 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.834996 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835000 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835004 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835008 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835012 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835016 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835019 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835023 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835027 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835030 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.035894 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835034 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835039 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835043 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835050 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835054 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835059 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835063 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835067 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835070 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835074 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835079 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835082 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835086 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835090 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835094 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835098 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835102 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835106 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835110 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.036644 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835113 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835117 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835121 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835125 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835129 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835132 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835136 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835141 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835146 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835150 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835153 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835157 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835160 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.835164 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836132 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836141 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836145 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836149 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836154 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836157 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.038975 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836162 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836166 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836170 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836174 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836178 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836182 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836187 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836191 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836194 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836198 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836202 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836207 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836211 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836215 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836219 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836223 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836227 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836232 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836238 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836244 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.055388 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836249 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836253 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836257 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836260 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836264 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836269 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836272 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836276 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836280 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836285 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836290 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836294 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836298 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836303 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836307 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836312 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836315 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836319 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836323 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.056164 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836327 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836331 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836334 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836338 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836344 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836347 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836352 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836355 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836359 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836362 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836366 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836370 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836374 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836378 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836382 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836389 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836394 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836400 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836403 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.056957 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836407 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836411 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836416 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836419 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836423 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836441 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836445 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836449 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836454 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836457 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836462 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836465 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836469 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836473 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836477 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836480 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836484 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836488 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836492 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836498 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.057583 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836502 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836506 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836509 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836513 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836517 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836520 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836524 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836527 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836532 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836536 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836540 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836544 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836547 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836551 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.836555 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837074 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837081 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837088 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837092 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837097 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.058491 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837102 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837106 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837110 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837114 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837118 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837122 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837126 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837129 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837133 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837137 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837141 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837147 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837151 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837154 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837158 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837162 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837165 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837169 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837173 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.059300 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837176 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837181 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837185 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837190 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837193 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837197 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837200 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837204 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837208 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837212 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837216 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837219 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837224 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837227 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837232 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837235 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837239 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837243 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837247 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837251 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.060178 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837257 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837261 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837265 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837268 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837273 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837277 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837281 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837285 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837289 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837292 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837296 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837300 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837304 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837310 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837313 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837317 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837320 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837324 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837328 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837332 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.060810 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837335 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837339 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837342 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837346 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837350 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837354 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837358 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837362 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837366 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837370 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837374 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837378 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837382 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837386 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837390 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837393 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837398 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837402 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837405 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837409 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.061436 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837413 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837416 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837420 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837423 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837444 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837451 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837462 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837467 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837472 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837477 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837481 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837485 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837488 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837492 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.837496 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837572 2578 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837581 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837590 2578 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837596 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837602 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 15:57:21.062078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837607 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837613 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837619 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837623 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837628 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837633 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837637 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837642 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837647 2578 flags.go:64] FLAG: --cgroup-root="" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837652 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837656 2578 flags.go:64] FLAG: --client-ca-file="" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837660 2578 flags.go:64] FLAG: --cloud-provider="external" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837665 2578 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837670 2578 flags.go:64] FLAG: --cluster-domain="" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837674 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837679 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837683 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837690 2578 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837695 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837699 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837704 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837709 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837713 2578 flags.go:64] FLAG: --contention-profiling="false" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837717 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 15:57:21.062708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837721 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837726 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837729 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837735 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837739 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837744 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837748 2578 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837752 2578 flags.go:64] FLAG: --enable-server="true" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837756 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837763 2578 flags.go:64] FLAG: --event-burst="100" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837768 2578 flags.go:64] FLAG: --event-qps="50" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837772 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837776 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837780 2578 flags.go:64] FLAG: --eviction-hard="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837785 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837789 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837795 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837799 2578 flags.go:64] FLAG: --eviction-soft="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837803 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837807 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837811 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837816 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837820 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837824 2578 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837829 2578 flags.go:64] FLAG: --feature-gates="" Jul 08 15:57:21.063388 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837835 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837840 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837844 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837849 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837853 2578 flags.go:64] FLAG: --healthz-port="10248" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837858 2578 flags.go:64] FLAG: --help="false" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837862 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837866 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837871 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837875 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837879 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837884 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837888 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837892 2578 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837896 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837900 2578 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837904 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837909 2578 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837913 2578 flags.go:64] FLAG: --kube-reserved="" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837918 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837922 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837926 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837930 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837938 2578 flags.go:64] FLAG: --lock-file="" Jul 08 15:57:21.064174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837942 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837947 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837951 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837958 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837963 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837967 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837971 2578 flags.go:64] FLAG: --logging-format="text" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837975 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837981 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837985 2578 flags.go:64] FLAG: --manifest-url="" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837989 2578 flags.go:64] FLAG: --manifest-url-header="" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837995 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.837999 2578 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838004 2578 flags.go:64] FLAG: --max-pods="110" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838008 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838012 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838017 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838021 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838025 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838030 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838034 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838043 2578 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838048 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838052 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 15:57:21.064890 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838057 2578 flags.go:64] FLAG: --pod-cidr="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838060 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838068 2578 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838072 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838077 2578 flags.go:64] FLAG: --pods-per-core="0" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838081 2578 flags.go:64] FLAG: --port="10250" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838085 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838091 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0649661372d39526f" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838096 2578 flags.go:64] FLAG: --qos-reserved="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838100 2578 flags.go:64] FLAG: --read-only-port="10255" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838104 2578 flags.go:64] FLAG: --register-node="true" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838108 2578 flags.go:64] FLAG: --register-with-taints="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838114 2578 flags.go:64] FLAG: --registry-burst="10" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838118 2578 flags.go:64] FLAG: --registry-qps="5" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838122 2578 flags.go:64] FLAG: --reserved-cpus="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838125 2578 flags.go:64] FLAG: --reserved-memory="" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838131 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838137 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838141 2578 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838146 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838149 2578 flags.go:64] FLAG: --runonce="false" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838153 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838158 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838162 2578 flags.go:64] FLAG: --seccomp-default="false" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838166 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 15:57:21.065634 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838170 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838174 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838178 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838183 2578 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838187 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838192 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838196 2578 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838200 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838205 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838209 2578 flags.go:64] FLAG: --system-cgroups="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838214 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838221 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838225 2578 flags.go:64] FLAG: --tls-cert-file="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838229 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838259 2578 flags.go:64] FLAG: --tls-min-version="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838264 2578 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838268 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838272 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838277 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838281 2578 flags.go:64] FLAG: --v="2" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838287 2578 flags.go:64] FLAG: --version="false" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838293 2578 flags.go:64] FLAG: --vmodule="" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838298 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838303 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838477 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.066727 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838483 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838488 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838492 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838496 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838501 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838505 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838509 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838513 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838516 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838520 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838524 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838527 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838531 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838535 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838538 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838542 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838546 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838550 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838555 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838559 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.067477 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838562 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838567 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838571 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838574 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838578 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838582 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838585 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838588 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838592 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838596 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838600 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838605 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838609 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838613 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838616 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838620 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838624 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838627 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838631 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838635 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.272764 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838639 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838642 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838646 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838650 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838653 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838659 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838664 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838667 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838671 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838675 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838678 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838682 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838686 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838691 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838695 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838699 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838702 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838706 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838710 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838714 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.273904 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838717 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838721 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838725 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838733 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838737 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838741 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838746 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838750 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838754 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838758 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838762 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838766 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838769 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838773 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838777 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838780 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838784 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838787 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838791 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.274493 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838795 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838799 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838802 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838806 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838810 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838815 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838820 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838823 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838827 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838831 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838834 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838838 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838842 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838846 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838850 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838853 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838860 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838866 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.275161 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.838870 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.838915 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.849887 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.849907 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.849926 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.849935 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.849989 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.849993 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.849997 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850000 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850003 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850006 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850010 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850015 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.275715 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850019 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850022 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850025 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850028 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850032 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850034 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850038 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850041 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850044 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850046 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850049 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850052 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850055 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850057 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850060 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850063 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850065 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850070 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850080 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850082 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.276186 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850085 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850088 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850090 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850093 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850095 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850098 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850100 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850103 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850106 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850108 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850111 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850113 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850116 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850119 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850121 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850124 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850126 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850129 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850132 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850136 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.276796 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850138 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850141 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850143 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850146 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850149 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850151 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850154 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850158 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850161 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850166 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850169 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850172 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850175 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850177 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850180 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850183 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850185 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850188 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850190 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.277405 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850193 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850195 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850198 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850200 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850203 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850205 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850208 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850210 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850213 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850216 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850218 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850221 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850224 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850227 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850229 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850232 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850234 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850237 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850239 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850242 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.277988 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850244 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850246 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850251 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850254 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850256 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850258 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850261 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850264 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850266 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850269 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850271 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850274 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.850279 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850400 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850405 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:57:21.278686 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850408 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850411 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850414 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850417 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850420 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850423 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850426 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850449 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850454 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850457 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850461 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850464 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850468 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850472 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850475 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850478 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850480 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850483 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850485 2578 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850488 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:57:21.279374 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850493 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850496 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850498 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850501 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850503 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850506 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850509 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850511 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850514 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850517 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850519 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850522 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850524 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850527 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850529 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850532 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850534 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850537 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850539 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850542 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:57:21.280054 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850546 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850548 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850551 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850556 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850559 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850562 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850564 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850567 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850569 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850572 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850574 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850576 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850580 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850583 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850585 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850588 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850590 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850593 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850595 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850598 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:57:21.280759 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850600 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850603 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850606 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850608 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850611 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850613 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850615 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850618 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850621 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850623 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850626 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850629 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850632 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850635 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850637 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850639 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850642 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850646 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850649 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:57:21.281455 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850652 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850655 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850658 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850660 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850663 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850667 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850670 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850672 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850675 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850677 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850679 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850682 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850685 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850687 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850690 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850692 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850696 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:57:21.282147 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:20.850698 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.850704 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.850798 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.854221 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.855889 2578 server.go:1019] "Starting client certificate rotation" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.855983 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.856014 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.858540 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.859581 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.873911 2578 log.go:25] "Validated CRI v1 runtime API" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.876209 2578 log.go:25] "Validated CRI v1 image API" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.877544 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 15:57:21.282786 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.882927 2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c73fd8c7-a9d4-47a1-8ce3-19d2de189282:/dev/nvme0n1p3 f86efe8e-5ab4-4547-813b-d904a22b3901:/dev/nvme0n1p4] Jul 08 15:57:21.283231 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.882951 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.888334 2578 manager.go:216] Machine: {Timestamp:2026-07-08 15:57:20.887868759 +0000 UTC m=+0.389990555 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3114821 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24f2981ebb929203233565163f85b1 SystemUUID:ec24f298-1ebb-9292-0323-3565163f85b1 BootID:69fcbb2d-d0f2-48fb-94d1-669b1832d941 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:70:42:de:02:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:70:42:de:02:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1e:21:ac:2d:17:0f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.888463 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.888563 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.891734 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.891756 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-83.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.892636 2578 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.892645 2578 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 15:57:21.283454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.892652 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.893366 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.894955 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899266 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899390 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899737 2578 kubelet.go:486] "Attempting to sync node with API server" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899756 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899773 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899782 2578 kubelet.go:398] "Adding apiserver pod source" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.899792 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.901854 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.901889 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.903668 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.905204 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.907546 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.907586 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909167 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909181 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909187 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909194 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909203 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909209 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909217 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909223 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909229 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909235 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909244 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.909250 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.910993 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.911001 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.912429 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-83.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.912520 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.912713 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.914325 2578 server.go:1268] "Started kubelet" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.914731 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.914798 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.915235 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.916640 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.918060 2578 server.go:310] "Adding debug handlers to kubelet server" Jul 08 15:57:21.283859 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.920536 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.923724 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.923740 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.923801 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924575 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924577 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924637 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924645 2578 factory.go:55] Registering systemd factory Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924666 2578 factory.go:223] Registration of the systemd container factory successfully Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924773 2578 reconstruct.go:97] "Volume reconstruction finished" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924782 2578 reconciler.go:29] "Reconciler: start to sync state" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924906 2578 factory.go:153] Registering CRI-O factory Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924918 2578 factory.go:223] Registration of the crio container factory successfully Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924962 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924981 2578 factory.go:103] Registering Raw factory Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.924991 2578 manager.go:1196] Started watching for new ooms in manager Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.925444 2578 manager.go:349] Starting recovery of all containers Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.933770 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.933843 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-83.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.933892 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-83.ec2.internal.18c05baaa548d6df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-83.ec2.internal,UID:ip-10-0-133-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-83.ec2.internal,},FirstTimestamp:2026-07-08 15:57:20.914298591 +0000 UTC m=+0.416420391,LastTimestamp:2026-07-08 15:57:20.914298591 +0000 UTC m=+0.416420391,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-83.ec2.internal,}" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.938964 2578 manager.go:354] Recovery completed Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.944156 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.948662 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.948706 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.948718 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.949302 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.949310 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.949326 2578 state_mem.go:36] "Initialized new in-memory state store" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.949370 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.950090 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.950115 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.285034 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.950126 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.950908 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-83.ec2.internal.18c05baaa7559581 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-83.ec2.internal,UID:ip-10-0-133-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-83.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-83.ec2.internal,},FirstTimestamp:2026-07-08 15:57:20.948688257 +0000 UTC m=+0.450810055,LastTimestamp:2026-07-08 15:57:20.948688257 +0000 UTC m=+0.450810055,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-83.ec2.internal,}" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.951587 2578 policy_none.go:49] "None policy: Start" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.951603 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.951615 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.953330 2578 policy_none.go:47] "Start" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.963351 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-83.ec2.internal.18c05baaa755f417 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-83.ec2.internal,UID:ip-10-0-133-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-83.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-83.ec2.internal,},FirstTimestamp:2026-07-08 15:57:20.948712471 +0000 UTC m=+0.450834270,LastTimestamp:2026-07-08 15:57:20.948712471 +0000 UTC m=+0.450834270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-83.ec2.internal,}" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.966243 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dx4q" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.977394 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-83.ec2.internal.18c05baaa7561be3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-83.ec2.internal,UID:ip-10-0-133-83.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-83.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-83.ec2.internal,},FirstTimestamp:2026-07-08 15:57:20.948722659 +0000 UTC m=+0.450844458,LastTimestamp:2026-07-08 15:57:20.948722659 +0000 UTC m=+0.450844458,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-83.ec2.internal,}" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.980728 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dx4q" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.998282 2578 manager.go:337] "Starting Device Plugin manager" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:20.998526 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.998550 2578 server.go:87] "Starting device plugin registration server" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.998763 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.998773 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.998877 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.999037 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:20.999045 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.000328 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.000368 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.286270 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.099752 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.100757 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.100787 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.100797 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.100826 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.114409 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.114428 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-83.ec2.internal\": node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.142197 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.155623 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.156903 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.156949 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.156977 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.157020 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.159855 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.243231 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.257402 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal"] Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.257503 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.258850 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.258879 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.258890 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.260658 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.260766 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.260793 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261415 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261460 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261478 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261490 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261512 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.261530 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.262978 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.263007 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.272916 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.272942 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.272953 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:21.584174 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.288148 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-83.ec2.internal\" not found" node="ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.294346 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-83.ec2.internal\" not found" node="ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.327382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.327409 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.327430 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608cb704942ea47d5ae3121b19e8816a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"608cb704942ea47d5ae3121b19e8816a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.344354 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428354 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608cb704942ea47d5ae3121b19e8816a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"608cb704942ea47d5ae3121b19e8816a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428400 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428432 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428482 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0a62a7c5f8a147f18700067b83a89f3f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal\" (UID: \"0a62a7c5f8a147f18700067b83a89f3f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.428496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/608cb704942ea47d5ae3121b19e8816a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-83.ec2.internal\" (UID: \"608cb704942ea47d5ae3121b19e8816a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.445744 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.586220 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.546475 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.838542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.595357 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.838542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.598592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:21.838542 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.646735 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.838542 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.747804 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:21.838542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.833210 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.848189 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.854766 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.854869 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.854888 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:21.948267 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.985215 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:52:21 +0000 UTC" deadline="2028-03-16 17:22:26.947916942 +0000 UTC" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:21.985267 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14809h25m4.962671836s" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.010293 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.012169 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.012197 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.012211 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:57:22.101183 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:22.049707 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:22.151227 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-83.ec2.internal\" not found" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.181648 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.224564 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.243632 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.244743 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.270040 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:22.306901 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608cb704942ea47d5ae3121b19e8816a.slice/crio-9a3652898602e7aa277b6494a74350287a65bd36210cab12e6e7c6f08baf1e32 WatchSource:0}: Error finding container 9a3652898602e7aa277b6494a74350287a65bd36210cab12e6e7c6f08baf1e32: Status 404 returned error can't find the container with id 9a3652898602e7aa277b6494a74350287a65bd36210cab12e6e7c6f08baf1e32 Jul 08 15:57:22.335587 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.312726 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 15:57:22.598152 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:22.372175 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a62a7c5f8a147f18700067b83a89f3f.slice/crio-c6fd0702d0e8c491d2481f397afbdfefa91d119eca2604997f488eae0e565e26 WatchSource:0}: Error finding container c6fd0702d0e8c491d2481f397afbdfefa91d119eca2604997f488eae0e565e26: Status 404 returned error can't find the container with id c6fd0702d0e8c491d2481f397afbdfefa91d119eca2604997f488eae0e565e26 Jul 08 15:57:22.598152 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.504837 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.907724 2578 apiserver.go:52] "Watching apiserver" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.917814 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.918252 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dhfz5","openshift-cluster-node-tuning-operator/tuned-qvqbg","openshift-image-registry/node-ca-rk4t8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal","openshift-multus/multus-additional-cni-plugins-bnvqv","openshift-multus/network-metrics-daemon-55wm5","openshift-network-operator/iptables-alerter-tdsd9","kube-system/konnectivity-agent-stvjw","kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh","openshift-dns/node-resolver-sdzht","openshift-multus/multus-rfnvc","openshift-network-diagnostics/network-check-target-rcvl5","openshift-ovn-kubernetes/ovnkube-node-msxqz"] Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.920494 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.921980 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.923694 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.926117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.926316 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.926553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.926733 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.926862 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hhpkq\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927059 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927119 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:22.927184 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927214 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927277 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927485 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927766 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.927878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929014 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929151 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-md465\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929219 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929375 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mjhz9\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929393 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 15:57:22.977215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.929737 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:22.929801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.932193 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:22.932251 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.933949 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-config\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovn-node-metrics-cert\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-os-release\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937424 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-modprobe-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937481 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-sys\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937544 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-netns\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:22.978301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937642 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-systemd-units\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysconfig\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937805 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-systemd\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937834 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-tmp\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdk9t\" (UniqueName: \"kubernetes.io/projected/666b4d4a-12d2-4be6-b715-7fc444fd248e-kube-api-access-bdk9t\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937947 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-bin\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.937979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-cnibin\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938013 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938047 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-kubernetes\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938120 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-tuned\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-slash\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938205 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-etc-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979009 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938234 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-node-log\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-lib-modules\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-kubelet\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938382 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-log-socket\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938829 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938862 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-script-lib\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938885 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxn7\" (UniqueName: \"kubernetes.io/projected/a6cd88be-3c64-44af-92fe-afb0a5879e27-kube-api-access-4zxn7\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938938 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-ovn\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-netd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.938980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-env-overrides\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939005 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlqnm\" (UniqueName: \"kubernetes.io/projected/19257791-f21e-4c19-ba9b-03abf5b5c9af-kube-api-access-tlqnm\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-run\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.979942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-host\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939091 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-systemd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-var-lib-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939135 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-system-cni-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939157 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-conf\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939183 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-var-lib-kubelet\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.939868 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.941375 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.943055 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfnvc" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.945266 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.948962 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.948996 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.958553 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.958635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pcg77\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.958556 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.958718 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.966059 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.967060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.967498 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rxdfs\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.967661 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.967754 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fw6gb\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bm2bw\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c8pbk\"" Jul 08 15:57:22.980816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968295 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pjc7g\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968352 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968408 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968576 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968661 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.968674 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 15:57:22.982542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:22.975309 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.026533 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.039908 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-env-overrides\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.039935 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8d10b2b-480a-443c-9863-8c710574e93a-konnectivity-ca\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.039953 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.039976 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-k8s-cni-cncf-io\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040012 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-multus-certs\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlqnm\" (UniqueName: \"kubernetes.io/projected/19257791-f21e-4c19-ba9b-03abf5b5c9af-kube-api-access-tlqnm\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-run\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040359 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-run\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8d10b2b-480a-443c-9863-8c710574e93a-agent-certs\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040420 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-host\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040454 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040492 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-etc-kubernetes\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040530 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-systemd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.067947 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040556 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-var-lib-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040581 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-socket-dir-parent\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-var-lib-kubelet\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040649 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040674 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-env-overrides\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040680 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-config\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040722 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-kubelet-config\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040754 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-netns\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-iptables-alerter-script\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040789 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-var-lib-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040824 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-var-lib-kubelet\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040848 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-systemd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040849 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-os-release\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.069083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040901 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-modprobe-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040920 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-os-release\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040932 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-sys\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040976 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.040995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-serviceca\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041006 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-modprobe-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041018 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-sys\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-device-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041092 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pjpt\" (UniqueName: \"kubernetes.io/projected/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kube-api-access-5pjpt\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041146 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysconfig\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-systemd\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.069906 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041228 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-systemd\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysconfig\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-netd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-bin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.041340 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-multus\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-config\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042217 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbc9g\" (UniqueName: \"kubernetes.io/projected/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-kube-api-access-kbc9g\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042261 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-kubernetes\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042324 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-netd\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042349 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-tuned\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042381 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-log-socket\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.070801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxn7\" (UniqueName: \"kubernetes.io/projected/a6cd88be-3c64-44af-92fe-afb0a5879e27-kube-api-access-4zxn7\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042497 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042571 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkszx\" (UniqueName: \"kubernetes.io/projected/e5a35bb9-7fea-4443-a58d-40d1c976cc46-kube-api-access-wkszx\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-lib-modules\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-script-lib\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042674 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042740 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-ovn\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-os-release\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-host\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042852 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042881 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cni-binary-copy\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042888 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042923 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-conf-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.071714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042965 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-system-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.042998 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-kubelet\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-system-cni-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043057 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-conf\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-lib-modules\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovn-node-metrics-cert\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4df404f-22bc-4c43-b6cd-3facfa6fb969-tmp-dir\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043149 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-kubernetes\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043191 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-hostroot\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043224 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r5zf\" (UniqueName: \"kubernetes.io/projected/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-kube-api-access-8r5zf\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043297 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-netns\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzdmb\" (UniqueName: \"kubernetes.io/projected/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-kube-api-access-lzdmb\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043358 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-systemd-units\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.075481 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-system-cni-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043839 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovnkube-script-lib\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-tmp\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.043913 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044089 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-systemd-units\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044098 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdk9t\" (UniqueName: \"kubernetes.io/projected/666b4d4a-12d2-4be6-b715-7fc444fd248e-kube-api-access-bdk9t\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044160 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-bin\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044168 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-run-ovn\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044185 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-netns\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044194 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044264 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-host\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044284 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-conf\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-log-socket\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044401 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044414 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-host-slash\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.076163 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044440 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-cni-bin\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-run-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-cnibin\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/19257791-f21e-4c19-ba9b-03abf5b5c9af-cnibin\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044501 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044535 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044581 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-slash\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044667 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-sysctl-d\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044715 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-etc-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044749 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-node-log\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4df404f-22bc-4c43-b6cd-3facfa6fb969-hosts-file\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044825 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-slash\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-kubelet\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044871 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-node-log\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.078456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044926 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-dbus\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044958 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.044986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw627\" (UniqueName: \"kubernetes.io/projected/c4df404f-22bc-4c43-b6cd-3facfa6fb969-kube-api-access-kw627\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.045016 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cnibin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.045063 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-daemon-config\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.045171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-host-kubelet\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.045210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6cd88be-3c64-44af-92fe-afb0a5879e27-etc-openvswitch\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.045382 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/19257791-f21e-4c19-ba9b-03abf5b5c9af-cni-binary-copy\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.049668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-etc-tuned\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.049725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/666b4d4a-12d2-4be6-b715-7fc444fd248e-tmp\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.050526 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6cd88be-3c64-44af-92fe-afb0a5879e27-ovn-node-metrics-cert\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.079401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.060932 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmz9r" Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.080583 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlqnm\" (UniqueName: \"kubernetes.io/projected/19257791-f21e-4c19-ba9b-03abf5b5c9af-kube-api-access-tlqnm\") pod \"multus-additional-cni-plugins-bnvqv\" (UID: \"19257791-f21e-4c19-ba9b-03abf5b5c9af\") " pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.080999 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.081020 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.081034 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.081109 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:23.581091003 +0000 UTC m=+3.083212811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.081239 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxn7\" (UniqueName: \"kubernetes.io/projected/a6cd88be-3c64-44af-92fe-afb0a5879e27-kube-api-access-4zxn7\") pod \"ovnkube-node-msxqz\" (UID: \"a6cd88be-3c64-44af-92fe-afb0a5879e27\") " pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.082413 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.082146 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdk9t\" (UniqueName: \"kubernetes.io/projected/666b4d4a-12d2-4be6-b715-7fc444fd248e-kube-api-access-bdk9t\") pod \"tuned-qvqbg\" (UID: \"666b4d4a-12d2-4be6-b715-7fc444fd248e\") " pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.085394 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.084084 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qmz9r" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.145999 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-socket-dir-parent\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146040 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-kubelet-config\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146068 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-netns\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146096 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-iptables-alerter-script\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146122 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-serviceca\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146189 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-device-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pjpt\" (UniqueName: \"kubernetes.io/projected/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kube-api-access-5pjpt\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-bin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146306 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-multus\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbc9g\" (UniqueName: \"kubernetes.io/projected/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-kube-api-access-kbc9g\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146364 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.164260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146398 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkszx\" (UniqueName: \"kubernetes.io/projected/e5a35bb9-7fea-4443-a58d-40d1c976cc46-kube-api-access-wkszx\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146426 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-os-release\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cni-binary-copy\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-conf-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-system-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146573 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-kubelet\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146602 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4df404f-22bc-4c43-b6cd-3facfa6fb969-tmp-dir\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146626 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-hostroot\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146651 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r5zf\" (UniqueName: \"kubernetes.io/projected/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-kube-api-access-8r5zf\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146678 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzdmb\" (UniqueName: \"kubernetes.io/projected/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-kube-api-access-lzdmb\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146710 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-host-slash\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146765 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4df404f-22bc-4c43-b6cd-3facfa6fb969-hosts-file\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146790 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-dbus\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.165907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146841 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw627\" (UniqueName: \"kubernetes.io/projected/c4df404f-22bc-4c43-b6cd-3facfa6fb969-kube-api-access-kw627\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146871 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cnibin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146897 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-daemon-config\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146925 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8d10b2b-480a-443c-9863-8c710574e93a-konnectivity-ca\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146954 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.146981 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-k8s-cni-cncf-io\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-multus-certs\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8d10b2b-480a-443c-9863-8c710574e93a-agent-certs\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-host\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147090 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147115 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-etc-kubernetes\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147202 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-etc-kubernetes\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-socket-dir-parent\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147315 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-kubelet-config\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.167999 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-netns\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.147926 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-iptables-alerter-script\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.148032 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.148091 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:23.648073455 +0000 UTC m=+3.150195246 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.148632 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-serviceca\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.148747 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-socket-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.148803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-device-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.149038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-bin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.149081 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-cni-multus\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.149270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-sys-fs\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.149446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.149490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-os-release\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150008 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cni-binary-copy\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150068 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-conf-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150119 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-system-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.168936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150160 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-var-lib-kubelet\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150361 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-cnibin\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150383 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-host-slash\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150409 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c4df404f-22bc-4c43-b6cd-3facfa6fb969-tmp-dir\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150421 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c4df404f-22bc-4c43-b6cd-3facfa6fb969-hosts-file\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150444 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-hostroot\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150567 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-dbus\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.150582 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.150651 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:23.650635568 +0000 UTC m=+3.152757368 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150707 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-registration-dir\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150748 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-multus-certs\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150778 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-host\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-daemon-config\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150858 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-multus-cni-dir\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150915 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-host-run-k8s-cni-cncf-io\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.171973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.150951 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fe9ea2c2-8159-4037-afdc-7a09728c50f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.172924 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.151249 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a8d10b2b-480a-443c-9863-8c710574e93a-konnectivity-ca\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.172924 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.154408 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a8d10b2b-480a-443c-9863-8c710574e93a-agent-certs\") pod \"konnectivity-agent-stvjw\" (UID: \"a8d10b2b-480a-443c-9863-8c710574e93a\") " pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.172924 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.163707 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"0a62a7c5f8a147f18700067b83a89f3f","Type":"ContainerStarted","Data":"c6fd0702d0e8c491d2481f397afbdfefa91d119eca2604997f488eae0e565e26"} Jul 08 15:57:23.172924 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.166759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" event={"ID":"608cb704942ea47d5ae3121b19e8816a","Type":"ContainerStarted","Data":"9a3652898602e7aa277b6494a74350287a65bd36210cab12e6e7c6f08baf1e32"} Jul 08 15:57:23.180337 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.179436 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbc9g\" (UniqueName: \"kubernetes.io/projected/6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4-kube-api-access-kbc9g\") pod \"multus-rfnvc\" (UID: \"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4\") " pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.183372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.181870 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pjpt\" (UniqueName: \"kubernetes.io/projected/fe9ea2c2-8159-4037-afdc-7a09728c50f0-kube-api-access-5pjpt\") pod \"aws-ebs-csi-driver-node-rlnvh\" (UID: \"fe9ea2c2-8159-4037-afdc-7a09728c50f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.220736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r5zf\" (UniqueName: \"kubernetes.io/projected/38ab5a95-b10b-44bd-8f1b-4cb56c958d88-kube-api-access-8r5zf\") pod \"iptables-alerter-tdsd9\" (UID: \"38ab5a95-b10b-44bd-8f1b-4cb56c958d88\") " pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.220744 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw627\" (UniqueName: \"kubernetes.io/projected/c4df404f-22bc-4c43-b6cd-3facfa6fb969-kube-api-access-kw627\") pod \"node-resolver-sdzht\" (UID: \"c4df404f-22bc-4c43-b6cd-3facfa6fb969\") " pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.220769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkszx\" (UniqueName: \"kubernetes.io/projected/e5a35bb9-7fea-4443-a58d-40d1c976cc46-kube-api-access-wkszx\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.223031 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzdmb\" (UniqueName: \"kubernetes.io/projected/ee42f286-3196-4bcb-8822-3aaa9b2b4d73-kube-api-access-lzdmb\") pod \"node-ca-rk4t8\" (UID: \"ee42f286-3196-4bcb-8822-3aaa9b2b4d73\") " pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.237685 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.245338 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" Jul 08 15:57:23.256239 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.255713 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.262988 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tdsd9" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.271476 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.289754 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sdzht" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.289827 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.294140 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rfnvc" Jul 08 15:57:23.325723 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.301505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rk4t8" Jul 08 15:57:23.398970 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.341866 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:23.410895 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.410857 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cd88be_3c64_44af_92fe_afb0a5879e27.slice/crio-44b7c5de20065a738ac07f0ff3c2eccdea4c7a597bdbb51aa22a786b1aa248c3 WatchSource:0}: Error finding container 44b7c5de20065a738ac07f0ff3c2eccdea4c7a597bdbb51aa22a786b1aa248c3: Status 404 returned error can't find the container with id 44b7c5de20065a738ac07f0ff3c2eccdea4c7a597bdbb51aa22a786b1aa248c3 Jul 08 15:57:23.414160 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.414104 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666b4d4a_12d2_4be6_b715_7fc444fd248e.slice/crio-77050309d1a34ab30d9cc88f29ce0783dc1937deb5fc3259a1083e1460cbcb50 WatchSource:0}: Error finding container 77050309d1a34ab30d9cc88f29ce0783dc1937deb5fc3259a1083e1460cbcb50: Status 404 returned error can't find the container with id 77050309d1a34ab30d9cc88f29ce0783dc1937deb5fc3259a1083e1460cbcb50 Jul 08 15:57:23.414753 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.414728 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19257791_f21e_4c19_ba9b_03abf5b5c9af.slice/crio-96d7d8716d252b6b544ff41ccf6bae80c9ec2747028567a8ec488fe7076abd12 WatchSource:0}: Error finding container 96d7d8716d252b6b544ff41ccf6bae80c9ec2747028567a8ec488fe7076abd12: Status 404 returned error can't find the container with id 96d7d8716d252b6b544ff41ccf6bae80c9ec2747028567a8ec488fe7076abd12 Jul 08 15:57:23.427680 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.427651 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ab5a95_b10b_44bd_8f1b_4cb56c958d88.slice/crio-26677c3bd7d8b989aeff28af613a56e58636e821fdac9c970502a0d2562c5d67 WatchSource:0}: Error finding container 26677c3bd7d8b989aeff28af613a56e58636e821fdac9c970502a0d2562c5d67: Status 404 returned error can't find the container with id 26677c3bd7d8b989aeff28af613a56e58636e821fdac9c970502a0d2562c5d67 Jul 08 15:57:23.437947 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.437916 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4df404f_22bc_4c43_b6cd_3facfa6fb969.slice/crio-7e36d79ca45020aa2d495b3f8721b602288d040602cf13ce7ee23a15bd7c0e5f WatchSource:0}: Error finding container 7e36d79ca45020aa2d495b3f8721b602288d040602cf13ce7ee23a15bd7c0e5f: Status 404 returned error can't find the container with id 7e36d79ca45020aa2d495b3f8721b602288d040602cf13ce7ee23a15bd7c0e5f Jul 08 15:57:23.442391 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.442362 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b11430c_6fd1_4b7f_9c2d_9c49742eb1b4.slice/crio-e3ae3c3003d06a8463390bbc8bf8ff7fcd82582b2214ef3bd20236c6465297fb WatchSource:0}: Error finding container e3ae3c3003d06a8463390bbc8bf8ff7fcd82582b2214ef3bd20236c6465297fb: Status 404 returned error can't find the container with id e3ae3c3003d06a8463390bbc8bf8ff7fcd82582b2214ef3bd20236c6465297fb Jul 08 15:57:23.445360 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:57:23.445338 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d10b2b_480a_443c_9863_8c710574e93a.slice/crio-1e749b345cf5005df33e876618f83580440a28cdfb46de5c71086537ce08b8a9 WatchSource:0}: Error finding container 1e749b345cf5005df33e876618f83580440a28cdfb46de5c71086537ce08b8a9: Status 404 returned error can't find the container with id 1e749b345cf5005df33e876618f83580440a28cdfb46de5c71086537ce08b8a9 Jul 08 15:57:23.650583 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.650538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:23.650583 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.650587 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:23.650674 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650699 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650718 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650741 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650755 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:23.650774 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650770 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:23.651011 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650772 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:24.650752815 +0000 UTC m=+4.152874612 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:23.651011 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650816 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:24.650801148 +0000 UTC m=+4.152922937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:23.651011 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:23.650840 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:24.650829967 +0000 UTC m=+4.152951754 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:24.087899 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.087798 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:52:23 +0000 UTC" deadline="2028-04-23 20:24:54.929060924 +0000 UTC" Jul 08 15:57:24.087899 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.087875 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15724h27m30.841198185s" Jul 08 15:57:24.157470 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.157248 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:24.157470 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.157389 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:24.157717 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.157610 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:24.157782 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.157753 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:24.170689 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.170627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdsd9" event={"ID":"38ab5a95-b10b-44bd-8f1b-4cb56c958d88","Type":"ContainerStarted","Data":"26677c3bd7d8b989aeff28af613a56e58636e821fdac9c970502a0d2562c5d67"} Jul 08 15:57:24.172248 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.172184 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rk4t8" event={"ID":"ee42f286-3196-4bcb-8822-3aaa9b2b4d73","Type":"ContainerStarted","Data":"1725d2a83c2aaa68b896f67da00ce407d7e8ac56d9355d8055c239edca149bc1"} Jul 08 15:57:24.173790 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.173724 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" event={"ID":"fe9ea2c2-8159-4037-afdc-7a09728c50f0","Type":"ContainerStarted","Data":"31bcc2a43f545754808491fe7b0a30a338dcb59928b7313d0b70073efdde7a91"} Jul 08 15:57:24.175172 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.175149 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdzht" event={"ID":"c4df404f-22bc-4c43-b6cd-3facfa6fb969","Type":"ContainerStarted","Data":"7e36d79ca45020aa2d495b3f8721b602288d040602cf13ce7ee23a15bd7c0e5f"} Jul 08 15:57:24.176665 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.176640 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerStarted","Data":"96d7d8716d252b6b544ff41ccf6bae80c9ec2747028567a8ec488fe7076abd12"} Jul 08 15:57:24.178996 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.178969 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"44b7c5de20065a738ac07f0ff3c2eccdea4c7a597bdbb51aa22a786b1aa248c3"} Jul 08 15:57:24.180625 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.180580 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" event={"ID":"666b4d4a-12d2-4be6-b715-7fc444fd248e","Type":"ContainerStarted","Data":"77050309d1a34ab30d9cc88f29ce0783dc1937deb5fc3259a1083e1460cbcb50"} Jul 08 15:57:24.181934 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.181891 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stvjw" event={"ID":"a8d10b2b-480a-443c-9863-8c710574e93a","Type":"ContainerStarted","Data":"1e749b345cf5005df33e876618f83580440a28cdfb46de5c71086537ce08b8a9"} Jul 08 15:57:24.184092 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.184068 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfnvc" event={"ID":"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4","Type":"ContainerStarted","Data":"e3ae3c3003d06a8463390bbc8bf8ff7fcd82582b2214ef3bd20236c6465297fb"} Jul 08 15:57:24.658459 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.658419 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:24.658660 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.658490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:24.658660 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.658552 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:24.658839 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658688 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:24.658839 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658749 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:26.658729996 +0000 UTC m=+6.160851793 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:24.658839 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658830 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:24.659177 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658869 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:26.658855456 +0000 UTC m=+6.160977241 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:24.659177 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658954 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:24.659177 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658968 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:24.659177 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.658981 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:24.659177 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:24.659018 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:26.659006224 +0000 UTC m=+6.161128024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:24.752161 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:24.752126 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:57:25.088092 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:25.088043 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:52:23 +0000 UTC" deadline="2027-12-31 13:44:03.366098318 +0000 UTC" Jul 08 15:57:25.088092 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:25.088091 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12981h46m38.278013309s" Jul 08 15:57:25.157917 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:25.157262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:25.157917 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:25.157459 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:26.158037 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:26.157997 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:26.158564 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.158148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:26.158639 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:26.158602 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:26.158736 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.158712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:26.676192 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:26.676152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:26.676401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:26.676217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:26.676401 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:26.676286 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:26.676565 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.676496 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:26.676565 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.676518 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:26.676565 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.676532 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:26.676722 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.676593 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:30.676574806 +0000 UTC m=+10.178696605 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:26.677022 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.677000 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:26.677117 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.677057 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:30.677042307 +0000 UTC m=+10.179164107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:26.677214 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.677197 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:26.677270 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:26.677247 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:30.677232781 +0000 UTC m=+10.179354580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:27.159187 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:27.158643 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:27.159187 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:27.158776 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:28.157692 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:28.157658 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:28.157871 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:28.157801 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:28.158065 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:28.158043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:28.158225 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:28.158202 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:29.157805 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:29.157765 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:29.158279 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:29.157908 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:30.157535 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:30.157499 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:30.157535 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:30.157514 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:30.157790 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.157657 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:30.157865 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.157800 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:30.713550 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:30.713600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:30.713676 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713826 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713864 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713901 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:30.713920 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713925 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:30.714433 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713939 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:30.714433 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.713905 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:38.713884096 +0000 UTC m=+18.216005899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:30.714433 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.714002 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:38.713985678 +0000 UTC m=+18.216107465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:30.714433 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:30.714019 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:38.714009377 +0000 UTC m=+18.216131173 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:31.158246 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:31.158213 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:31.158714 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:31.158329 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:32.157387 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:32.157351 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:32.157565 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:32.157510 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:32.157907 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:32.157889 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:32.158048 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:32.157987 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:33.157804 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:33.157773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:33.158261 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:33.157906 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:34.158915 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:34.158161 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:34.158915 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:34.158302 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:34.158915 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:34.158730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:34.158915 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:34.158852 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:35.157556 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:35.157516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:35.157720 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:35.157636 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:36.158063 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:36.157871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:36.158570 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:36.157871 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:36.158570 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:36.158165 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:36.158570 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:36.158218 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:37.157249 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:37.157215 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:37.157417 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:37.157336 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:38.157598 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:38.157564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:38.157968 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:38.157564 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:38.157968 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.157693 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:38.157968 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.157728 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:38.774672 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:38.774637 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:38.774855 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:38.774683 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:38.774855 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:38.774736 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:38.774855 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774832 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774833 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774896 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774913 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774925 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774892 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:57:54.774875161 +0000 UTC m=+34.276996958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774977 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:54.774954375 +0000 UTC m=+34.277076171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:38.775009 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:38.774990 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:57:54.774983876 +0000 UTC m=+34.277105658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:39.157827 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:39.157741 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:39.158240 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:39.157867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:40.158155 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:40.158115 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:40.158590 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:40.158226 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:40.158590 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:40.158282 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:40.158590 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:40.158417 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:41.158514 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:41.158485 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:41.158898 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:41.158569 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:42.157545 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:42.157505 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:42.157545 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:42.157532 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:42.157765 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:42.157661 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:42.157832 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:42.157805 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:43.158234 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.158065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:43.158916 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:43.158311 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:43.223286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.223073 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"41172f61ec89729e7111e7bc7ed5f54785e5979a72cc5d691f5a3497dd544011"} Jul 08 15:57:43.223286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.223164 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"d953960a75cf1c71cfd49919337118cd23fab860aa96d2a3570a7414d36f00ca"} Jul 08 15:57:43.223286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.223215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"cc4b1f65aab646c3eb6293bb45a205de2fdc651684eaedfaa8bc3e7662b2a478"} Jul 08 15:57:43.223286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.223262 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"e7a1390ee9964922deb53e66805da3a6a2fc020e58af1a17764b57235a0787bb"} Jul 08 15:57:43.224883 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.224858 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" event={"ID":"666b4d4a-12d2-4be6-b715-7fc444fd248e","Type":"ContainerStarted","Data":"bb93a5bc341c05cc3a28102da1714af7044aba46ae7fcbc018b6a3aab3bf0b6f"} Jul 08 15:57:43.226413 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.226390 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rfnvc" event={"ID":"6b11430c-6fd1-4b7f-9c2d-9c49742eb1b4","Type":"ContainerStarted","Data":"40340a4905e0a86c76fa69c1e0bf39e586228f5b815f75e0195188662bee7296"} Jul 08 15:57:43.227790 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.227772 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" event={"ID":"608cb704942ea47d5ae3121b19e8816a","Type":"ContainerStarted","Data":"0ae0143acbc29c0bbaf0cbdeaa7cd879f5ebdd23c33d69cc0c950f4b9a51d00a"} Jul 08 15:57:43.267626 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.267570 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qvqbg" podStartSLOduration=3.376752355 podStartE2EDuration="22.267549687s" totalImagesPullingTime="18.890797332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:43.246168189 +0000 UTC m=+22.748289995" watchObservedRunningTime="2026-07-08 15:57:43.267549687 +0000 UTC m=+22.769671493" Jul 08 15:57:43.268285 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.268242 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rfnvc" podStartSLOduration=2.047111212 podStartE2EDuration="21.268231848s" totalImagesPullingTime="19.221120636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:43.268207305 +0000 UTC m=+22.770329112" watchObservedRunningTime="2026-07-08 15:57:43.268231848 +0000 UTC m=+22.770353653" Jul 08 15:57:43.284200 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:43.284164 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-83.ec2.internal" podStartSLOduration=21.284151782 podStartE2EDuration="21.284151782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:43.284013508 +0000 UTC m=+22.786135315" watchObservedRunningTime="2026-07-08 15:57:43.284151782 +0000 UTC m=+22.786273586" Jul 08 15:57:44.158189 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.158154 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:44.158425 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.158199 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:44.158425 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:44.158271 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:44.158425 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:44.158413 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:44.232079 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.231972 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tdsd9" event={"ID":"38ab5a95-b10b-44bd-8f1b-4cb56c958d88","Type":"ContainerStarted","Data":"b65b1bf12dfefd1e965d6162fffcd9ad06ad317951244be2ef79a835de91e201"} Jul 08 15:57:44.233597 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.233536 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rk4t8" event={"ID":"ee42f286-3196-4bcb-8822-3aaa9b2b4d73","Type":"ContainerStarted","Data":"6ce60cb40a936091ba7d2d7baafcc2be38cc0e096e4ac48276ff91268fc90760"} Jul 08 15:57:44.235182 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.235144 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" event={"ID":"fe9ea2c2-8159-4037-afdc-7a09728c50f0","Type":"ContainerStarted","Data":"bf3d119a35cdaa2e908b965832640a2bbe58505c74c4955346a128bb50b7c34e"} Jul 08 15:57:44.236646 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.236622 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sdzht" event={"ID":"c4df404f-22bc-4c43-b6cd-3facfa6fb969","Type":"ContainerStarted","Data":"b8b34f49fa3af094371383223e6c3d33e0329c4415c95aa606417f02206188b3"} Jul 08 15:57:44.238259 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.238233 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="bde3bd495022c85eac5a653794a8562caddebb7f8532fea671835fb8865f7a54" exitCode=0 Jul 08 15:57:44.238348 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.238307 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"bde3bd495022c85eac5a653794a8562caddebb7f8532fea671835fb8865f7a54"} Jul 08 15:57:44.243624 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.243591 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"1f5bcfd18da78331b53008d9e7ade051030ea1a838ebda690bbe805dd255388c"} Jul 08 15:57:44.243757 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.243676 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"9bc1097cd88b479fa4403e1f54a0e6272dce67930f1e4bbc4770ccb30d620f62"} Jul 08 15:57:44.245545 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.245507 2578 generic.go:356] "Generic (PLEG): container finished" podID="0a62a7c5f8a147f18700067b83a89f3f" containerID="2e37f7c958f76cc14fdb67f64a341023e2d027e421c8951334eda5afe7e07405" exitCode=0 Jul 08 15:57:44.245637 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.245588 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"0a62a7c5f8a147f18700067b83a89f3f","Type":"ContainerDied","Data":"2e37f7c958f76cc14fdb67f64a341023e2d027e421c8951334eda5afe7e07405"} Jul 08 15:57:44.247091 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.247066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-stvjw" event={"ID":"a8d10b2b-480a-443c-9863-8c710574e93a","Type":"ContainerStarted","Data":"3c593b3d677695b92e6a5accd8377ade0d5c32036b74c9576dc2b246591d1c70"} Jul 08 15:57:44.272641 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.272605 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tdsd9" podStartSLOduration=3.077857949 podStartE2EDuration="22.272593172s" totalImagesPullingTime="19.194735223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.253965557 +0000 UTC m=+23.756087364" watchObservedRunningTime="2026-07-08 15:57:44.272593172 +0000 UTC m=+23.774714977" Jul 08 15:57:44.331740 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.331698 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-stvjw" podStartSLOduration=3.46733165 podStartE2EDuration="22.331682467s" totalImagesPullingTime="18.864350817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.31394503 +0000 UTC m=+23.816066834" watchObservedRunningTime="2026-07-08 15:57:44.331682467 +0000 UTC m=+23.833804272" Jul 08 15:57:44.331910 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.331886 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sdzht" podStartSLOduration=11.454804216 podStartE2EDuration="22.33187999s" totalImagesPullingTime="10.877075774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.33165645 +0000 UTC m=+23.833778280" watchObservedRunningTime="2026-07-08 15:57:44.33187999 +0000 UTC m=+23.834001794" Jul 08 15:57:44.348870 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.348834 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rk4t8" podStartSLOduration=11.484220862 podStartE2EDuration="22.348823385s" totalImagesPullingTime="10.864602523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:44.348601761 +0000 UTC m=+23.850723567" watchObservedRunningTime="2026-07-08 15:57:44.348823385 +0000 UTC m=+23.850945190" Jul 08 15:57:44.905474 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:44.905417 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 15:57:45.012257 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.012145 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T15:57:44.905458013Z","UUID":"fd45d360-609f-45bb-94c8-3e33a74536a3","Handler":null,"Name":"","Endpoint":""} Jul 08 15:57:45.013903 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.013883 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 15:57:45.014019 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.013927 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 15:57:45.157798 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.157722 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:45.157961 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:45.157838 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:45.251229 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.251180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" event={"ID":"fe9ea2c2-8159-4037-afdc-7a09728c50f0","Type":"ContainerStarted","Data":"f515427f0941ce8ed8b1189559181b46a841b15204e7c79550a44f449ec7a337"} Jul 08 15:57:45.253059 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:45.253032 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" event={"ID":"0a62a7c5f8a147f18700067b83a89f3f","Type":"ContainerStarted","Data":"414ac4e1580642edabf5cd32b72036d1689ebabcbf0edc5ba18bf6737e1c1351"} Jul 08 15:57:46.158167 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.158094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:46.158350 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:46.158203 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:46.158350 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.158264 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:46.158484 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:46.158375 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:46.257422 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.257388 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" event={"ID":"fe9ea2c2-8159-4037-afdc-7a09728c50f0","Type":"ContainerStarted","Data":"d7a123be3644f05299d8ae5a96b704ec31b641d0c9bea4de3ac78d0da1c6e1fd"} Jul 08 15:57:46.260331 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.260309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"82a8cb5e0fd91b6f9ae09f9bd755497bf00d8a50efe761b1fbdad730795f3312"} Jul 08 15:57:46.278157 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.278115 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-83.ec2.internal" podStartSLOduration=24.278102058 podStartE2EDuration="24.278102058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:45.287661287 +0000 UTC m=+24.789783091" watchObservedRunningTime="2026-07-08 15:57:46.278102058 +0000 UTC m=+25.780223862" Jul 08 15:57:46.278422 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.278395 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rlnvh" podStartSLOduration=2.661507233 podStartE2EDuration="24.278386854s" totalImagesPullingTime="21.616879621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:46.2778285 +0000 UTC m=+25.779950324" watchObservedRunningTime="2026-07-08 15:57:46.278386854 +0000 UTC m=+25.780508658" Jul 08 15:57:46.343217 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.343181 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:46.343905 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:46.343885 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:47.157781 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:47.157742 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:47.157944 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:47.157880 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:47.314449 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:47.314400 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:47.315134 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:47.315078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-stvjw" Jul 08 15:57:48.157729 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:48.157691 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:48.157729 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:48.157719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:48.157976 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:48.157815 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:48.157976 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:48.157955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:49.157632 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:49.157601 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:49.158061 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:49.157732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:50.158289 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.158129 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:50.158943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.158172 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:50.158943 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:50.158361 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:50.158943 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:50.158464 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:50.271190 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.271158 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="27c0c175a1fd9fa35e8974e69241127493527ee80047fa9b47377e76179efbba" exitCode=0 Jul 08 15:57:50.271354 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.271236 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"27c0c175a1fd9fa35e8974e69241127493527ee80047fa9b47377e76179efbba"} Jul 08 15:57:50.274957 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.274935 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" event={"ID":"a6cd88be-3c64-44af-92fe-afb0a5879e27","Type":"ContainerStarted","Data":"fe1212484fbe9858145cd947bc80a4e56a2a3df92e6d36a814a442393cea9891"} Jul 08 15:57:50.275210 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.275191 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:50.275268 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.275262 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:50.275333 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.275311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:50.290799 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.290779 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:50.290910 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.290877 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:57:50.331825 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:50.331786 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" podStartSLOduration=10.03539577 podStartE2EDuration="29.331772701s" totalImagesPullingTime="19.296376931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:50.331766196 +0000 UTC m=+29.833888001" watchObservedRunningTime="2026-07-08 15:57:50.331772701 +0000 UTC m=+29.833894499" Jul 08 15:57:51.158984 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:51.158807 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:51.159353 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:51.159053 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:52.157312 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:52.157275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:52.157476 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:52.157391 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:52.157476 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:52.157419 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:52.157572 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:52.157528 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:52.280808 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:52.280775 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="ae7b300905fe05c94c57e3555e37b24ac866c309392e8e80f66b886876a7489c" exitCode=0 Jul 08 15:57:52.281142 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:52.280859 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"ae7b300905fe05c94c57e3555e37b24ac866c309392e8e80f66b886876a7489c"} Jul 08 15:57:53.157240 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:53.157212 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:53.157393 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:53.157326 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:54.158074 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.158043 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:54.158483 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.158044 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:54.158483 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.158150 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:54.158483 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.158218 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:54.288003 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.287971 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="b1e5aed62d75e3f4f38a2dc0d72d05120a7cceecb4eb95a65d367a7b5d7bd816" exitCode=0 Jul 08 15:57:54.288165 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.288029 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"b1e5aed62d75e3f4f38a2dc0d72d05120a7cceecb4eb95a65d367a7b5d7bd816"} Jul 08 15:57:54.796169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.796141 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.796179 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:54.796204 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796283 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796303 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796318 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796326 2578 projected.go:196] Error preparing data for projected volume kube-api-access-5c8cf for pod openshift-network-diagnostics/network-check-target-rcvl5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:54.796358 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796337 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret podName:dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a nodeName:}" failed. No retries permitted until 2026-07-08 15:58:26.79632301 +0000 UTC m=+66.298444796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret") pod "global-pull-secret-syncer-dhfz5" (UID: "dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:57:54.796621 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796366 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf podName:2419a223-2817-43fe-82ba-c518019976d9 nodeName:}" failed. No retries permitted until 2026-07-08 15:58:26.796351412 +0000 UTC m=+66.298473217 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c8cf" (UniqueName: "kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf") pod "network-check-target-rcvl5" (UID: "2419a223-2817-43fe-82ba-c518019976d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:57:54.796621 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796302 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:54.796621 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:54.796394 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs podName:e5a35bb9-7fea-4443-a58d-40d1c976cc46 nodeName:}" failed. No retries permitted until 2026-07-08 15:58:26.7963881 +0000 UTC m=+66.298509883 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs") pod "network-metrics-daemon-55wm5" (UID: "e5a35bb9-7fea-4443-a58d-40d1c976cc46") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:57:55.157386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:55.157310 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:55.157567 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:55.157447 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:56.157762 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:56.157719 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:56.158192 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:56.157842 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:56.158192 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:56.157891 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:56.158192 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:56.158020 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:57.157506 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:57.157467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:57.157716 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:57.157603 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:58.157883 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:58.157834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:57:58.158294 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:58.157851 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:57:58.158294 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:58.158017 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:57:58.158294 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:58.158086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:57:59.159891 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:59.159866 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:57:59.160311 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:57:59.159973 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:57:59.300872 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:59.300842 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="f8aa78784ddeb64695b1e642bdc0125272e0b7be5ee59bf04ee39d44e117c88c" exitCode=0 Jul 08 15:57:59.301058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:57:59.300892 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"f8aa78784ddeb64695b1e642bdc0125272e0b7be5ee59bf04ee39d44e117c88c"} Jul 08 15:58:00.157954 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:00.157923 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:00.157954 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:00.157954 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:00.158151 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:00.158045 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:00.158151 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:00.158140 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:00.306272 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:00.306243 2578 generic.go:356] "Generic (PLEG): container finished" podID="19257791-f21e-4c19-ba9b-03abf5b5c9af" containerID="08cd64c1bfa932264d891db3038c7548cb96a07851822bbc9b60f1e2055f89be" exitCode=0 Jul 08 15:58:00.306671 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:00.306296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerDied","Data":"08cd64c1bfa932264d891db3038c7548cb96a07851822bbc9b60f1e2055f89be"} Jul 08 15:58:01.160305 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:01.160276 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:01.160489 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:01.160362 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:58:01.311699 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:01.311666 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" event={"ID":"19257791-f21e-4c19-ba9b-03abf5b5c9af","Type":"ContainerStarted","Data":"d4c106cda69ad83362b6ee59830356b62f63d384baaa768e3dec73c8f0713ecc"} Jul 08 15:58:01.366739 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:01.366698 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bnvqv" podStartSLOduration=9.41826932 podStartE2EDuration="40.366681509s" totalImagesPullingTime="30.948412189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:01.366570095 +0000 UTC m=+40.868691899" watchObservedRunningTime="2026-07-08 15:58:01.366681509 +0000 UTC m=+40.868803313" Jul 08 15:58:02.157584 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:02.157555 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:02.157746 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:02.157644 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:02.157746 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:02.157699 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:02.157816 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:02.157790 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:03.160680 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:03.160649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:03.161049 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:03.160767 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:58:04.158092 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.158058 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:04.158248 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:04.158167 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:04.158248 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.158216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:04.158325 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:04.158308 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:04.670367 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.670339 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcvl5"] Jul 08 15:58:04.670846 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.670455 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:04.670846 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:04.670538 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:58:04.677059 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.677027 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhfz5"] Jul 08 15:58:04.677157 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.677106 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:04.677200 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:04.677180 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:04.686043 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.685991 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55wm5"] Jul 08 15:58:04.686137 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:04.686067 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:04.686191 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:04.686142 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:06.157553 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:06.157523 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:06.157553 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:06.157541 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:06.157946 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:06.157611 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:06.157946 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:06.157623 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:58:06.157946 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:06.157679 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:06.157946 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:06.157770 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:08.157480 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:08.157421 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:08.157480 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:08.157484 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:08.157949 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:08.157536 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:08.157949 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:08.157548 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dhfz5" podUID="dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a" Jul 08 15:58:08.157949 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:08.157602 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rcvl5" podUID="2419a223-2817-43fe-82ba-c518019976d9" Jul 08 15:58:08.157949 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:08.157732 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-55wm5" podUID="e5a35bb9-7fea-4443-a58d-40d1c976cc46" Jul 08 15:58:09.285141 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.285108 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-83.ec2.internal" event="NodeReady" Jul 08 15:58:09.285506 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.285232 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 15:58:09.353590 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.353564 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6lwqf"] Jul 08 15:58:09.382817 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.382794 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sqxhd"] Jul 08 15:58:09.382930 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.382919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.388935 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.388912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 15:58:09.389144 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.389083 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nqzhj\"" Jul 08 15:58:09.391927 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.391898 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 15:58:09.398561 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.398542 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lwqf"] Jul 08 15:58:09.398645 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.398583 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xtrfd"] Jul 08 15:58:09.398683 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.398661 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.403919 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.403901 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 15:58:09.404091 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.403980 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nhx4m\"" Jul 08 15:58:09.404351 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.404337 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 15:58:09.404456 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.404374 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 15:58:09.404622 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.404606 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 15:58:09.415137 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.415120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqxhd"] Jul 08 15:58:09.415211 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.415152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.418573 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.418556 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 15:58:09.420507 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.420229 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xtrfd"] Jul 08 15:58:09.423925 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.421317 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 15:58:09.423925 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.421467 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 15:58:09.423925 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.421625 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z2sl2\"" Jul 08 15:58:09.508356 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508328 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6d4aa7-c586-4605-b654-3dc27e30796f-data-volume\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.508356 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6d4aa7-c586-4605-b654-3dc27e30796f-crio-socket\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508374 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508389 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da20bb99-c830-40a3-a5e2-875ebbab577a-cert\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508410 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc04790-9138-41e4-950e-c35bf8db7d6c-tmp-dir\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508478 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc04790-9138-41e4-950e-c35bf8db7d6c-config-volume\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508502 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc04790-9138-41e4-950e-c35bf8db7d6c-metrics-tls\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.508527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvjc\" (UniqueName: \"kubernetes.io/projected/1dc04790-9138-41e4-950e-c35bf8db7d6c-kube-api-access-hcvjc\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.508743 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508554 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6d4aa7-c586-4605-b654-3dc27e30796f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.508743 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508573 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4n4j\" (UniqueName: \"kubernetes.io/projected/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-api-access-v4n4j\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.508743 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.508606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpwnd\" (UniqueName: \"kubernetes.io/projected/da20bb99-c830-40a3-a5e2-875ebbab577a-kube-api-access-vpwnd\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.609620 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609594 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6d4aa7-c586-4605-b654-3dc27e30796f-crio-socket\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.609620 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609621 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.609802 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609638 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da20bb99-c830-40a3-a5e2-875ebbab577a-cert\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.609802 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc04790-9138-41e4-950e-c35bf8db7d6c-tmp-dir\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.609802 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609671 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc04790-9138-41e4-950e-c35bf8db7d6c-config-volume\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.609802 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609743 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc04790-9138-41e4-950e-c35bf8db7d6c-metrics-tls\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.609802 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvjc\" (UniqueName: \"kubernetes.io/projected/1dc04790-9138-41e4-950e-c35bf8db7d6c-kube-api-access-hcvjc\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.610029 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6d4aa7-c586-4605-b654-3dc27e30796f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.610029 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609859 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4n4j\" (UniqueName: \"kubernetes.io/projected/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-api-access-v4n4j\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.610029 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.609901 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/df6d4aa7-c586-4605-b654-3dc27e30796f-crio-socket\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.610172 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610042 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1dc04790-9138-41e4-950e-c35bf8db7d6c-tmp-dir\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.610278 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610243 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1dc04790-9138-41e4-950e-c35bf8db7d6c-config-volume\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.610278 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610268 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpwnd\" (UniqueName: \"kubernetes.io/projected/da20bb99-c830-40a3-a5e2-875ebbab577a-kube-api-access-vpwnd\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.610465 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6d4aa7-c586-4605-b654-3dc27e30796f-data-volume\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.610542 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.610698 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.610668 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/df6d4aa7-c586-4605-b654-3dc27e30796f-data-volume\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.613662 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.613635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/df6d4aa7-c586-4605-b654-3dc27e30796f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.613740 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.613712 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1dc04790-9138-41e4-950e-c35bf8db7d6c-metrics-tls\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.613831 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.613816 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da20bb99-c830-40a3-a5e2-875ebbab577a-cert\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.622280 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.622244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvjc\" (UniqueName: \"kubernetes.io/projected/1dc04790-9138-41e4-950e-c35bf8db7d6c-kube-api-access-hcvjc\") pod \"dns-default-6lwqf\" (UID: \"1dc04790-9138-41e4-950e-c35bf8db7d6c\") " pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.622408 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.622271 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4n4j\" (UniqueName: \"kubernetes.io/projected/df6d4aa7-c586-4605-b654-3dc27e30796f-kube-api-access-v4n4j\") pod \"insights-runtime-extractor-sqxhd\" (UID: \"df6d4aa7-c586-4605-b654-3dc27e30796f\") " pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.624266 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.624251 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpwnd\" (UniqueName: \"kubernetes.io/projected/da20bb99-c830-40a3-a5e2-875ebbab577a-kube-api-access-vpwnd\") pod \"ingress-canary-xtrfd\" (UID: \"da20bb99-c830-40a3-a5e2-875ebbab577a\") " pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.694190 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.694127 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:09.706307 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.706288 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqxhd" Jul 08 15:58:09.724957 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.724937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xtrfd" Jul 08 15:58:09.899619 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.899591 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqxhd"] Jul 08 15:58:09.902789 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:09.902758 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf6d4aa7_c586_4605_b654_3dc27e30796f.slice/crio-89ab4ef523539f47b8f1d87339ca7e9881bbf816f5a851716b6588d0dfeb2324 WatchSource:0}: Error finding container 89ab4ef523539f47b8f1d87339ca7e9881bbf816f5a851716b6588d0dfeb2324: Status 404 returned error can't find the container with id 89ab4ef523539f47b8f1d87339ca7e9881bbf816f5a851716b6588d0dfeb2324 Jul 08 15:58:09.903885 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.903863 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xtrfd"] Jul 08 15:58:09.905794 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:09.905770 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda20bb99_c830_40a3_a5e2_875ebbab577a.slice/crio-721b7c602b2d7a263ded7811cebac3283c39775e780ceb3e5cc095b8c9fcaa90 WatchSource:0}: Error finding container 721b7c602b2d7a263ded7811cebac3283c39775e780ceb3e5cc095b8c9fcaa90: Status 404 returned error can't find the container with id 721b7c602b2d7a263ded7811cebac3283c39775e780ceb3e5cc095b8c9fcaa90 Jul 08 15:58:09.910595 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:09.910514 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6lwqf"] Jul 08 15:58:09.913794 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:09.913771 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc04790_9138_41e4_950e_c35bf8db7d6c.slice/crio-44766a8a97f23fda423ba237e55e1ace1420b8a823214c3c4a8ff88a98dbe1da WatchSource:0}: Error finding container 44766a8a97f23fda423ba237e55e1ace1420b8a823214c3c4a8ff88a98dbe1da: Status 404 returned error can't find the container with id 44766a8a97f23fda423ba237e55e1ace1420b8a823214c3c4a8ff88a98dbe1da Jul 08 15:58:10.158192 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.158160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:10.158346 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.158159 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:10.158346 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.158160 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:10.162943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.162916 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hnkgn\"" Jul 08 15:58:10.163067 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.163019 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 15:58:10.163113 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.163075 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 15:58:10.163113 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.163077 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 15:58:10.163207 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.163137 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 15:58:10.163245 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.163206 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6nvh\"" Jul 08 15:58:10.332798 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.332616 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xtrfd" event={"ID":"da20bb99-c830-40a3-a5e2-875ebbab577a","Type":"ContainerStarted","Data":"721b7c602b2d7a263ded7811cebac3283c39775e780ceb3e5cc095b8c9fcaa90"} Jul 08 15:58:10.333973 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.333948 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqxhd" event={"ID":"df6d4aa7-c586-4605-b654-3dc27e30796f","Type":"ContainerStarted","Data":"89ab4ef523539f47b8f1d87339ca7e9881bbf816f5a851716b6588d0dfeb2324"} Jul 08 15:58:10.335174 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:10.335118 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lwqf" event={"ID":"1dc04790-9138-41e4-950e-c35bf8db7d6c","Type":"ContainerStarted","Data":"44766a8a97f23fda423ba237e55e1ace1420b8a823214c3c4a8ff88a98dbe1da"} Jul 08 15:58:15.654188 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.654097 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5"] Jul 08 15:58:15.656678 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.656650 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.659605 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.659574 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjwwb\" (UniqueName: \"kubernetes.io/projected/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-kube-api-access-pjwwb\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.659712 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.659619 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.659712 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.659658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.659712 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.659683 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.662198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.662180 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 15:58:15.662446 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.662417 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 15:58:15.662545 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.662496 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 15:58:15.662595 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.662567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 15:58:15.663772 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.663625 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 15:58:15.663772 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.663634 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-lpjnq\"" Jul 08 15:58:15.679256 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.679239 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5"] Jul 08 15:58:15.761958 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.761917 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjwwb\" (UniqueName: \"kubernetes.io/projected/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-kube-api-access-pjwwb\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.762084 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.761982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.762084 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.762018 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.762084 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.762042 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.762862 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.762826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.763764 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:15.763736 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 08 15:58:15.763865 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:15.763800 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls podName:b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c nodeName:}" failed. No retries permitted until 2026-07-08 15:58:16.263781432 +0000 UTC m=+55.765903228 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-26hw5" (UID: "b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c") : secret "prometheus-operator-tls" not found Jul 08 15:58:15.769305 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.769256 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:15.774557 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:15.774533 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjwwb\" (UniqueName: \"kubernetes.io/projected/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-kube-api-access-pjwwb\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:16.264946 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.264777 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:16.267795 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.267777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-26hw5\" (UID: \"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:16.268503 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.268488 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" Jul 08 15:58:16.353026 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.352997 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xtrfd" event={"ID":"da20bb99-c830-40a3-a5e2-875ebbab577a","Type":"ContainerStarted","Data":"de9046f67d38b89250e91763779fe539c3dc5295fa911af8792acdea8e9255ba"} Jul 08 15:58:16.354567 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.354537 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqxhd" event={"ID":"df6d4aa7-c586-4605-b654-3dc27e30796f","Type":"ContainerStarted","Data":"8c62e78278ec58683dc9202489527ce3d286731f94345f53f6d994555cf69504"} Jul 08 15:58:16.356140 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.356120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lwqf" event={"ID":"1dc04790-9138-41e4-950e-c35bf8db7d6c","Type":"ContainerStarted","Data":"5108b8327f20e6236fdea6f3267df7196cb0ae8af180f4263b67d328557cd658"} Jul 08 15:58:16.356286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.356161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6lwqf" event={"ID":"1dc04790-9138-41e4-950e-c35bf8db7d6c","Type":"ContainerStarted","Data":"671c8d8f53fcfd38e67b95ed0fb0eecbc2d640606f3c0356c351ee05829cfb89"} Jul 08 15:58:16.356286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.356251 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:16.385963 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.385909 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xtrfd" podStartSLOduration=1.6156081 podStartE2EDuration="7.385363373s" totalImagesPullingTime="5.769755273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:16.385285757 +0000 UTC m=+55.887407582" watchObservedRunningTime="2026-07-08 15:58:16.385363373 +0000 UTC m=+55.887485156" Jul 08 15:58:16.413798 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:16.413777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5"] Jul 08 15:58:16.417765 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:16.417739 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c9ad46_f3f9_4a9e_9204_2c893ac4cc6c.slice/crio-c3bcda5cafee8557c2744849d2e93218b56b100219c2dbb75ea046f7812ecb00 WatchSource:0}: Error finding container c3bcda5cafee8557c2744849d2e93218b56b100219c2dbb75ea046f7812ecb00: Status 404 returned error can't find the container with id c3bcda5cafee8557c2744849d2e93218b56b100219c2dbb75ea046f7812ecb00 Jul 08 15:58:17.361873 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:17.361649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" event={"ID":"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c","Type":"ContainerStarted","Data":"c3bcda5cafee8557c2744849d2e93218b56b100219c2dbb75ea046f7812ecb00"} Jul 08 15:58:17.364418 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:17.364355 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqxhd" event={"ID":"df6d4aa7-c586-4605-b654-3dc27e30796f","Type":"ContainerStarted","Data":"78384135dc876e2971997c2229a9fefce90e5632f8664f077bac7f0bd3b14142"} Jul 08 15:58:18.376077 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:18.375982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" event={"ID":"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c","Type":"ContainerStarted","Data":"4b86703e535e164fea9ff92f81dd354b171eb150a427fd62a1dc752c23792768"} Jul 08 15:58:19.384678 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:19.384634 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" event={"ID":"b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c","Type":"ContainerStarted","Data":"528099ca34486064b8de1a8a29264bd1b0bc80c16a4a8c0f30867cf7bc256ca3"} Jul 08 15:58:19.386556 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:19.386533 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqxhd" event={"ID":"df6d4aa7-c586-4605-b654-3dc27e30796f","Type":"ContainerStarted","Data":"6562101a058e460eee807db62aece99abcd08a4d08d86d743c0a0b4188b381ba"} Jul 08 15:58:19.409367 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:19.409290 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6lwqf" podStartSLOduration=4.647022539 podStartE2EDuration="10.409276889s" totalImagesPullingTime="5.76225435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:16.420755568 +0000 UTC m=+55.922877375" watchObservedRunningTime="2026-07-08 15:58:19.409276889 +0000 UTC m=+58.911398694" Jul 08 15:58:19.409485 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:19.409372 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-26hw5" podStartSLOduration=2.768608391 podStartE2EDuration="4.409365747s" totalImagesPullingTime="1.640757356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:19.408977703 +0000 UTC m=+58.911099508" watchObservedRunningTime="2026-07-08 15:58:19.409365747 +0000 UTC m=+58.911487554" Jul 08 15:58:19.440392 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:19.440355 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sqxhd" podStartSLOduration=1.305478768 podStartE2EDuration="10.440344439s" totalImagesPullingTime="9.134865671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:58:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:19.439394018 +0000 UTC m=+58.941515907" watchObservedRunningTime="2026-07-08 15:58:19.440344439 +0000 UTC m=+58.942466243" Jul 08 15:58:21.287338 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.287307 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kc6pp"] Jul 08 15:58:21.297803 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.297780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.301968 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:21.301933 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-kc6pp\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" podUID="7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2" pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.302069 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:21.302024 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jul 08 15:58:21.302069 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:21.302024 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-q8rbd\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8rbd\"" type="*v1.Secret" Jul 08 15:58:21.307863 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:21.307840 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap" Jul 08 15:58:21.308227 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:21.308207 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-133-83.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-133-83.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret" Jul 08 15:58:21.404142 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-textfile\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404142 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404146 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-sys\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404161 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404180 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpxg\" (UniqueName: \"kubernetes.io/projected/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-kube-api-access-2hpxg\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404280 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-wtmp\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404340 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404330 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-root\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.404562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.404356 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-metrics-client-ca\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.499260 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.499233 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk"] Jul 08 15:58:21.505677 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505650 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-textfile\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.505789 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-sys\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.505789 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505706 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.505789 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505734 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.505789 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505761 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpxg\" (UniqueName: \"kubernetes.io/projected/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-kube-api-access-2hpxg\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.505789 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505773 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-sys\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505802 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-wtmp\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505964 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-wtmp\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505990 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-textfile\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.505998 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-root\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.506031 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-root\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506046 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.506036 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-metrics-client-ca\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.506414 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.506398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-metrics-client-ca\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.522615 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.522592 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.526480 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.526465 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 15:58:21.526797 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.526769 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 15:58:21.528717 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.528697 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-prlmq\"" Jul 08 15:58:21.530641 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.530619 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk"] Jul 08 15:58:21.531238 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.531220 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 15:58:21.531455 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.531235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpxg\" (UniqueName: \"kubernetes.io/projected/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-kube-api-access-2hpxg\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:21.606578 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606520 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.606578 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.606738 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8jl5\" (UniqueName: \"kubernetes.io/projected/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-api-access-t8jl5\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.606738 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606639 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.606738 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606666 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.606738 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.606693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707121 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707252 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707139 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8jl5\" (UniqueName: \"kubernetes.io/projected/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-api-access-t8jl5\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707252 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707169 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707252 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707216 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707482 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707591 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707574 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.707705 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.707683 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.708057 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.708035 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.708057 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.708054 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.709698 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.709669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.709785 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.709770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.718200 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.718178 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8jl5\" (UniqueName: \"kubernetes.io/projected/a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c-kube-api-access-t8jl5\") pod \"kube-state-metrics-7c9dbb8b7d-mk8pk\" (UID: \"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:21.831502 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:21.831467 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" Jul 08 15:58:22.016508 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.016478 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk"] Jul 08 15:58:22.019203 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:22.019183 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9271cf0_f7f6_44f9_af9d_e0c9336d5b8c.slice/crio-dbc587aa42b95c1c27573d300f184004a68d41fd60e45814d97c41c2c8b4f405 WatchSource:0}: Error finding container dbc587aa42b95c1c27573d300f184004a68d41fd60e45814d97c41c2c8b4f405: Status 404 returned error can't find the container with id dbc587aa42b95c1c27573d300f184004a68d41fd60e45814d97c41c2c8b4f405 Jul 08 15:58:22.295206 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.295183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-msxqz" Jul 08 15:58:22.306237 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.306220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 15:58:22.318631 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.318612 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:22.395854 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.395825 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" event={"ID":"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c","Type":"ContainerStarted","Data":"dbc587aa42b95c1c27573d300f184004a68d41fd60e45814d97c41c2c8b4f405"} Jul 08 15:58:22.421922 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.421895 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q8rbd\"" Jul 08 15:58:22.471652 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.471625 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:58:22.490794 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.490773 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.495812 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.495795 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 15:58:22.496475 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496336 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 15:58:22.496475 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496363 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 15:58:22.496475 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496384 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 15:58:22.496475 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496461 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 15:58:22.496475 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496458 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 15:58:22.496826 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496500 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 15:58:22.496826 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496702 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 15:58:22.496826 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.496797 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 15:58:22.497110 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.497094 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kcm88\"" Jul 08 15:58:22.503116 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.503099 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:58:22.508191 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:22.508100 2578 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition Jul 08 15:58:22.508191 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:22.508179 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config podName:7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2 nodeName:}" failed. No retries permitted until 2026-07-08 15:58:23.008159229 +0000 UTC m=+62.510281034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config") pod "node-exporter-kc6pp" (UID: "7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2") : failed to sync configmap cache: timed out waiting for the condition Jul 08 15:58:22.508366 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:22.508109 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: failed to sync secret cache: timed out waiting for the condition Jul 08 15:58:22.508420 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:58:22.508380 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls podName:7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2 nodeName:}" failed. No retries permitted until 2026-07-08 15:58:23.008364331 +0000 UTC m=+62.510486129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls") pod "node-exporter-kc6pp" (UID: "7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2") : failed to sync secret cache: timed out waiting for the condition Jul 08 15:58:22.512951 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.512934 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.512960 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.512980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513030 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513048 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513253 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513087 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513253 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513253 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4zqt\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513303 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513343 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.513372 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.513359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.604125 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.604061 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 15:58:22.614014 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.613982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614129 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614129 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614129 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614088 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614129 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614125 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614149 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614291 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614615 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4zqt\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614615 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614366 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614615 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614404 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.614777 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.614631 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.615966 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.615938 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.615966 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.615957 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.616904 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.616862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.617122 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.617101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.617543 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.617266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.617543 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.617499 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.617759 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.617737 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.617912 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.617889 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.618396 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.618378 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.618559 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.618543 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.618791 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.618772 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.630248 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.630220 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4zqt\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt\") pod \"alertmanager-main-0\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.640505 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.640486 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 15:58:22.799746 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.799714 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:58:22.951164 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:22.951133 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:58:22.955361 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:22.955334 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b588f0d_f38d_48d7_b612_db93098ec543.slice/crio-6af4be988afa667c32abf4ece0517a9d5faf63d9f57c641d137520f9045e88e4 WatchSource:0}: Error finding container 6af4be988afa667c32abf4ece0517a9d5faf63d9f57c641d137520f9045e88e4: Status 404 returned error can't find the container with id 6af4be988afa667c32abf4ece0517a9d5faf63d9f57c641d137520f9045e88e4 Jul 08 15:58:23.018564 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.018515 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:23.018725 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.018667 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:23.019217 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.019191 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:23.020887 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.020867 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2-node-exporter-tls\") pod \"node-exporter-kc6pp\" (UID: \"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2\") " pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:23.106391 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.106363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kc6pp" Jul 08 15:58:23.363221 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:23.363195 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb9d9d2_fc01_4f20_934a_a7f7d5acd4c2.slice/crio-c8b3de1d18ae5848aa14a8070d53a64c6b63794a4033344838b12d36783c096b WatchSource:0}: Error finding container c8b3de1d18ae5848aa14a8070d53a64c6b63794a4033344838b12d36783c096b: Status 404 returned error can't find the container with id c8b3de1d18ae5848aa14a8070d53a64c6b63794a4033344838b12d36783c096b Jul 08 15:58:23.400278 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.400248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kc6pp" event={"ID":"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2","Type":"ContainerStarted","Data":"c8b3de1d18ae5848aa14a8070d53a64c6b63794a4033344838b12d36783c096b"} Jul 08 15:58:23.401393 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:23.401358 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"6af4be988afa667c32abf4ece0517a9d5faf63d9f57c641d137520f9045e88e4"} Jul 08 15:58:24.408069 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:24.408035 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" event={"ID":"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c","Type":"ContainerStarted","Data":"5e810bb9ae50c8f64acb3b821c0fe2dffe1ae3e9f134498ff22c3bec90431792"} Jul 08 15:58:24.408425 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:24.408098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" event={"ID":"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c","Type":"ContainerStarted","Data":"72a9f47d60a51a01a9cf4db53fc1b8473075f917090dde4140d71edd350e01df"} Jul 08 15:58:24.408425 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:24.408129 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" event={"ID":"a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c","Type":"ContainerStarted","Data":"2438441cd92d9ed8fc68357685ad916939c55576e06c9c6657b7ac1b27781f2f"} Jul 08 15:58:24.430863 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:24.430813 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mk8pk" podStartSLOduration=2.063482922 podStartE2EDuration="3.430798864s" totalImagesPullingTime="1.367315942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:24.428857611 +0000 UTC m=+63.930979416" watchObservedRunningTime="2026-07-08 15:58:24.430798864 +0000 UTC m=+63.932920669" Jul 08 15:58:25.412838 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:25.412803 2578 generic.go:356] "Generic (PLEG): container finished" podID="7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2" containerID="14deaf2c7c5b262286798f0223d9b98f5c6016db428adafeeb4b669352dca877" exitCode=0 Jul 08 15:58:25.413241 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:25.412881 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kc6pp" event={"ID":"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2","Type":"ContainerDied","Data":"14deaf2c7c5b262286798f0223d9b98f5c6016db428adafeeb4b669352dca877"} Jul 08 15:58:25.416362 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:25.414708 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df" exitCode=0 Jul 08 15:58:25.416362 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:25.415980 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df"} Jul 08 15:58:26.366527 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.366497 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6lwqf" Jul 08 15:58:26.420423 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.420389 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kc6pp" event={"ID":"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2","Type":"ContainerStarted","Data":"f05660944893cc3b5456df5bd18e6804ce0b34265dc16a9782971cdd6e58f1cd"} Jul 08 15:58:26.420791 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.420470 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kc6pp" event={"ID":"7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2","Type":"ContainerStarted","Data":"0648fb9981387bfda67021b110791bec5bf284dd81d47983eb20dc4f6a378726"} Jul 08 15:58:26.439917 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.439871 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kc6pp" podStartSLOduration=4.098271547 podStartE2EDuration="5.439853727s" totalImagesPullingTime="1.275792638s" totalInitContainerRuntime="65.789542ms" isStatefulPod=true podCreationTimestamp="2026-07-08 15:58:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:26.439126413 +0000 UTC m=+65.941248220" watchObservedRunningTime="2026-07-08 15:58:26.439853727 +0000 UTC m=+65.941975532" Jul 08 15:58:26.851830 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.851786 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:26.852006 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.851842 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:26.852006 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.851889 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:26.854828 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.854805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 15:58:26.855958 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.855937 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 15:58:26.855958 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.855937 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 15:58:26.865533 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.865510 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a35bb9-7fea-4443-a58d-40d1c976cc46-metrics-certs\") pod \"network-metrics-daemon-55wm5\" (UID: \"e5a35bb9-7fea-4443-a58d-40d1c976cc46\") " pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:26.865625 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.865554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a-original-pull-secret\") pod \"global-pull-secret-syncer-dhfz5\" (UID: \"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a\") " pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:26.865950 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.865927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 15:58:26.876339 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.876318 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c8cf\" (UniqueName: \"kubernetes.io/projected/2419a223-2817-43fe-82ba-c518019976d9-kube-api-access-5c8cf\") pod \"network-check-target-rcvl5\" (UID: \"2419a223-2817-43fe-82ba-c518019976d9\") " pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:26.970497 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.970465 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f6nvh\"" Jul 08 15:58:26.974940 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.974910 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dhfz5" Jul 08 15:58:26.978902 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.978878 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:26.981551 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.981524 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hnkgn\"" Jul 08 15:58:26.989721 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:26.989704 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-55wm5" Jul 08 15:58:27.166771 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.165979 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dhfz5"] Jul 08 15:58:27.170190 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:27.170061 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcc2c9d5_9e11_4e99_9fa5_3edb67c4e19a.slice/crio-93f56cf65128cacb1e5ffd887160d16c4d25ca7468f2e753ea2baae0ef02c0da WatchSource:0}: Error finding container 93f56cf65128cacb1e5ffd887160d16c4d25ca7468f2e753ea2baae0ef02c0da: Status 404 returned error can't find the container with id 93f56cf65128cacb1e5ffd887160d16c4d25ca7468f2e753ea2baae0ef02c0da Jul 08 15:58:27.193088 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.191541 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-55wm5"] Jul 08 15:58:27.196116 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:27.196085 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a35bb9_7fea_4443_a58d_40d1c976cc46.slice/crio-8fb5455bb61d41ec0b4a437f1108de386c052845cda89fd47c0455f28a049b86 WatchSource:0}: Error finding container 8fb5455bb61d41ec0b4a437f1108de386c052845cda89fd47c0455f28a049b86: Status 404 returned error can't find the container with id 8fb5455bb61d41ec0b4a437f1108de386c052845cda89fd47c0455f28a049b86 Jul 08 15:58:27.205880 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.205777 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rcvl5"] Jul 08 15:58:27.210577 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:58:27.210554 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2419a223_2817_43fe_82ba_c518019976d9.slice/crio-1cb68d810f019908c99b3db2101b8316611d2cb465371f088cc51a8a05242252 WatchSource:0}: Error finding container 1cb68d810f019908c99b3db2101b8316611d2cb465371f088cc51a8a05242252: Status 404 returned error can't find the container with id 1cb68d810f019908c99b3db2101b8316611d2cb465371f088cc51a8a05242252 Jul 08 15:58:27.426872 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.426823 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcvl5" event={"ID":"2419a223-2817-43fe-82ba-c518019976d9","Type":"ContainerStarted","Data":"1cb68d810f019908c99b3db2101b8316611d2cb465371f088cc51a8a05242252"} Jul 08 15:58:27.428311 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.428259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55wm5" event={"ID":"e5a35bb9-7fea-4443-a58d-40d1c976cc46","Type":"ContainerStarted","Data":"8fb5455bb61d41ec0b4a437f1108de386c052845cda89fd47c0455f28a049b86"} Jul 08 15:58:27.429653 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.429627 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhfz5" event={"ID":"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a","Type":"ContainerStarted","Data":"93f56cf65128cacb1e5ffd887160d16c4d25ca7468f2e753ea2baae0ef02c0da"} Jul 08 15:58:27.433479 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.433453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975"} Jul 08 15:58:27.433569 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.433525 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375"} Jul 08 15:58:27.433651 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.433568 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a"} Jul 08 15:58:27.433651 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.433617 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72"} Jul 08 15:58:27.433803 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.433652 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6"} Jul 08 15:58:27.462696 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.462661 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:58:27.465826 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.465802 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.469522 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.469497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 15:58:27.469640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.469497 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4to15oq6n892r\"" Jul 08 15:58:27.469816 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.469794 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471884 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471920 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471935 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471968 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wgc7p\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471988 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471938 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 15:58:27.472177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.471891 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 15:58:27.472605 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.472195 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 15:58:27.472605 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.472232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 15:58:27.472605 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.472230 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 15:58:27.472605 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.472394 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 15:58:27.473334 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.473317 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 15:58:27.475498 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.475479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 15:58:27.478666 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.478644 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 15:58:27.496521 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.496501 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:58:27.556022 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.555993 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556022 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556028 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smj9b\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556057 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556130 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556202 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556225 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556282 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556307 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556359 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556383 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556399 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556462 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556505 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556533 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556567 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.556936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.556620 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657195 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657075 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657195 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657195 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657195 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657273 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657329 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657365 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657389 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smj9b\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657524 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.657562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657554 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657578 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657663 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.657985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.658365 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.658334 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660170 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.658465 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660170 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.658345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660170 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.659311 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660170 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.659642 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660504 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.660462 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.660774 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.660731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.661483 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.661442 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.662012 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.661987 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.662623 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.662165 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.662623 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.662579 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.662762 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.662705 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.663238 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.663195 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.663757 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.663736 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.664078 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.664046 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.664488 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.664463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.664653 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.664635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.665562 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.665538 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.667103 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.667082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smj9b\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b\") pod \"prometheus-k8s-0\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.778526 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.778487 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:58:27.935526 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:27.935448 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:58:28.442114 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:28.442076 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" exitCode=0 Jul 08 15:58:28.442674 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:28.442158 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} Jul 08 15:58:28.442674 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:28.442231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"b18fea9454c96aa668513a3d809c12687a618d656153f01d5f749cd81638cdf1"} Jul 08 15:58:29.453687 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:29.453581 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerStarted","Data":"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e"} Jul 08 15:58:29.456299 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:29.456239 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55wm5" event={"ID":"e5a35bb9-7fea-4443-a58d-40d1c976cc46","Type":"ContainerStarted","Data":"2201c8f7e2abeb62f2cf652eada094cbd1fbb0ca1a9f8bee684d7f1f86a18bab"} Jul 08 15:58:29.499663 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:29.498199 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4802263 podStartE2EDuration="7.498181821s" totalImagesPullingTime="5.001929512s" totalInitContainerRuntime="16.026009ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:29.497898684 +0000 UTC m=+69.000020490" watchObservedRunningTime="2026-07-08 15:58:29.498181821 +0000 UTC m=+69.000303651" Jul 08 15:58:30.464806 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:30.464767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-55wm5" event={"ID":"e5a35bb9-7fea-4443-a58d-40d1c976cc46","Type":"ContainerStarted","Data":"11a06fcc9880dddbdddec6e4828e5f9296fe198d89378b74ce702aa040e50451"} Jul 08 15:58:34.483048 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.483013 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rcvl5" event={"ID":"2419a223-2817-43fe-82ba-c518019976d9","Type":"ContainerStarted","Data":"2c5f7837068fdd5cbf598ad2cfb37ff971b67b84d9fcf67eb68dc997f6399cc3"} Jul 08 15:58:34.483531 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.483129 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:58:34.484927 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.484897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dhfz5" event={"ID":"dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a","Type":"ContainerStarted","Data":"2a28818f9aff6e1ad28eca8a34d8fb240a6567687fd7b700c3ae94b2a96f0a03"} Jul 08 15:58:34.487513 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.487486 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} Jul 08 15:58:34.487639 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.487547 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} Jul 08 15:58:34.501112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.501066 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rcvl5" podStartSLOduration=66.918394814 podStartE2EDuration="1m13.501048539s" totalImagesPullingTime="6.582653725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:34.499929339 +0000 UTC m=+74.002051168" watchObservedRunningTime="2026-07-08 15:58:34.501048539 +0000 UTC m=+74.003170342" Jul 08 15:58:34.502454 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.502404 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-55wm5" podStartSLOduration=70.603601874 podStartE2EDuration="1m12.502392694s" totalImagesPullingTime="1.89879082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:30.488527256 +0000 UTC m=+69.990649063" watchObservedRunningTime="2026-07-08 15:58:34.502392694 +0000 UTC m=+74.004514499" Jul 08 15:58:34.518576 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:34.518528 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dhfz5" podStartSLOduration=65.88123015 podStartE2EDuration="1m12.518511168s" totalImagesPullingTime="6.637281018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:34.518126922 +0000 UTC m=+74.020248727" watchObservedRunningTime="2026-07-08 15:58:34.518511168 +0000 UTC m=+74.020632974" Jul 08 15:58:36.499485 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:36.499454 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} Jul 08 15:58:36.499858 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:36.499540 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} Jul 08 15:58:36.499858 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:36.499570 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} Jul 08 15:58:36.499858 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:36.499594 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerStarted","Data":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} Jul 08 15:58:36.539522 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:36.539465 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.285029346 podStartE2EDuration="9.539426715s" totalImagesPullingTime="7.225475257s" totalInitContainerRuntime="28.922112ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:36.536818342 +0000 UTC m=+76.038940168" watchObservedRunningTime="2026-07-08 15:58:36.539426715 +0000 UTC m=+76.041548537" Jul 08 15:58:37.778932 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:58:37.778893 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:05.494535 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:05.494415 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rcvl5" Jul 08 15:59:27.778807 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:27.778769 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:27.797855 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:27.797825 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:28.694517 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:28.694489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:41.636610 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.636576 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.636844 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="alertmanager" containerID="cri-o://9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6" gracePeriod=120 Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.636935 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-metric" containerID="cri-o://3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975" gracePeriod=120 Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.636962 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-web" containerID="cri-o://2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a" gracePeriod=120 Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.636990 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="config-reloader" containerID="cri-o://4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72" gracePeriod=120 Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.637030 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy" containerID="cri-o://f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375" gracePeriod=120 Jul 08 15:59:41.637130 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:41.637062 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="prom-label-proxy" containerID="cri-o://05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e" gracePeriod=120 Jul 08 15:59:42.737083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737053 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e" exitCode=0 Jul 08 15:59:42.737083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737078 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375" exitCode=0 Jul 08 15:59:42.737083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737085 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a" exitCode=0 Jul 08 15:59:42.737083 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737090 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72" exitCode=0 Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737097 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6" exitCode=0 Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737120 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e"} Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737189 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375"} Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737217 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a"} Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737243 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72"} Jul 08 15:59:42.737574 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.737267 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6"} Jul 08 15:59:42.879668 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.879646 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:59:42.936442 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.936179 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.936701 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.936682 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4zqt\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.936852 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.936831 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.936980 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.936862 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.936980 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.936904 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937050 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937112 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937091 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937216 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937126 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937216 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937151 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937216 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937176 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937216 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937209 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937419 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937235 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.937419 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.937287 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets\") pod \"0b588f0d-f38d-48d7-b612-db93098ec543\" (UID: \"0b588f0d-f38d-48d7-b612-db93098ec543\") " Jul 08 15:59:42.938972 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.938096 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:42.938972 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.938392 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:42.938972 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.938655 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 15:59:42.940722 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.940483 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out" (OuterVolumeSpecName: "config-out") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 15:59:42.941808 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.941760 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume" (OuterVolumeSpecName: "config-volume") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.942152 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.942006 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.942152 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.942126 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.942549 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.942523 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.942661 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.942605 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt" (OuterVolumeSpecName: "kube-api-access-v4zqt") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "kube-api-access-v4zqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:42.942905 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.942863 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:42.943943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.943919 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.948286 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.948260 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:42.952519 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:42.952492 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config" (OuterVolumeSpecName: "web-config") pod "0b588f0d-f38d-48d7-b612-db93098ec543" (UID: "0b588f0d-f38d-48d7-b612-db93098ec543"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:43.038051 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038024 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038051 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038050 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038060 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b588f0d-f38d-48d7-b612-db93098ec543-metrics-client-ca\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038068 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-alertmanager-main-db\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038076 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038085 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-config-volume\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038093 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-main-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038102 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-cluster-tls-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038109 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-tls-assets\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038118 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b588f0d-f38d-48d7-b612-db93098ec543-config-out\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038125 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4zqt\" (UniqueName: \"kubernetes.io/projected/0b588f0d-f38d-48d7-b612-db93098ec543-kube-api-access-v4zqt\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038133 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-web-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.038203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.038141 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b588f0d-f38d-48d7-b612-db93098ec543-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:43.749728 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.749700 2578 generic.go:356] "Generic (PLEG): container finished" podID="0b588f0d-f38d-48d7-b612-db93098ec543" containerID="3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975" exitCode=0 Jul 08 15:59:43.750026 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.749754 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975"} Jul 08 15:59:43.750026 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.749778 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:59:43.750026 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.749834 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b588f0d-f38d-48d7-b612-db93098ec543","Type":"ContainerDied","Data":"6af4be988afa667c32abf4ece0517a9d5faf63d9f57c641d137520f9045e88e4"} Jul 08 15:59:43.750026 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.749871 2578 scope.go:117] "RemoveContainer" containerID="05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e" Jul 08 15:59:43.757409 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.757393 2578 scope.go:117] "RemoveContainer" containerID="3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975" Jul 08 15:59:43.764039 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.764024 2578 scope.go:117] "RemoveContainer" containerID="f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375" Jul 08 15:59:43.771491 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.771470 2578 scope.go:117] "RemoveContainer" containerID="2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a" Jul 08 15:59:43.775868 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.775845 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:59:43.778602 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.778567 2578 scope.go:117] "RemoveContainer" containerID="4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72" Jul 08 15:59:43.780690 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.780672 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:59:43.785541 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.785522 2578 scope.go:117] "RemoveContainer" containerID="9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6" Jul 08 15:59:43.792293 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.792277 2578 scope.go:117] "RemoveContainer" containerID="c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df" Jul 08 15:59:43.798801 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.798784 2578 scope.go:117] "RemoveContainer" containerID="05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e" Jul 08 15:59:43.799121 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.799090 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e\": container with ID starting with 05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e not found: ID does not exist" containerID="05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e" Jul 08 15:59:43.799215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799130 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e"} err="failed to get container status \"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e\": rpc error: code = NotFound desc = could not find container \"05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e\": container with ID starting with 05fb3f11b15520e64dc2766791eea8aa3141f1842bc267fa1ea230895e73d01e not found: ID does not exist" Jul 08 15:59:43.799215 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799168 2578 scope.go:117] "RemoveContainer" containerID="3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975" Jul 08 15:59:43.799495 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.799472 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975\": container with ID starting with 3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975 not found: ID does not exist" containerID="3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975" Jul 08 15:59:43.799577 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799502 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975"} err="failed to get container status \"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975\": rpc error: code = NotFound desc = could not find container \"3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975\": container with ID starting with 3b2cbafca6c06e330ce4c22f30ee47069d216f429a1b644203980881fbec6975 not found: ID does not exist" Jul 08 15:59:43.799577 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799525 2578 scope.go:117] "RemoveContainer" containerID="f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375" Jul 08 15:59:43.799852 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.799823 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375\": container with ID starting with f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375 not found: ID does not exist" containerID="f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375" Jul 08 15:59:43.799950 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799856 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375"} err="failed to get container status \"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375\": rpc error: code = NotFound desc = could not find container \"f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375\": container with ID starting with f9cef5dfc47b7dc980694fd29a7f277b06b363579dbd99560f3e350f892c1375 not found: ID does not exist" Jul 08 15:59:43.799950 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.799871 2578 scope.go:117] "RemoveContainer" containerID="2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a" Jul 08 15:59:43.800135 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.800119 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a\": container with ID starting with 2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a not found: ID does not exist" containerID="2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a" Jul 08 15:59:43.800177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800140 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a"} err="failed to get container status \"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a\": rpc error: code = NotFound desc = could not find container \"2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a\": container with ID starting with 2c25f3cc8aab97ee3d18a50381ff941f7e8d65e460c88832968d9873d109ed9a not found: ID does not exist" Jul 08 15:59:43.800177 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800160 2578 scope.go:117] "RemoveContainer" containerID="4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72" Jul 08 15:59:43.800448 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.800412 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72\": container with ID starting with 4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72 not found: ID does not exist" containerID="4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72" Jul 08 15:59:43.800494 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800452 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72"} err="failed to get container status \"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72\": rpc error: code = NotFound desc = could not find container \"4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72\": container with ID starting with 4b3b719c7bf2f8056f467972a0ab53abdb5bbc8595ced349946e8d92c562fa72 not found: ID does not exist" Jul 08 15:59:43.800494 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800467 2578 scope.go:117] "RemoveContainer" containerID="9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6" Jul 08 15:59:43.800694 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.800661 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6\": container with ID starting with 9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6 not found: ID does not exist" containerID="9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6" Jul 08 15:59:43.800739 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800698 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6"} err="failed to get container status \"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6\": rpc error: code = NotFound desc = could not find container \"9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6\": container with ID starting with 9cf7c02992f3721831f841bc15a1d51e7e29b54bb34ac9a8d03726a142acdbd6 not found: ID does not exist" Jul 08 15:59:43.800739 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800710 2578 scope.go:117] "RemoveContainer" containerID="c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df" Jul 08 15:59:43.800942 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:43.800927 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df\": container with ID starting with c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df not found: ID does not exist" containerID="c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df" Jul 08 15:59:43.800980 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:43.800948 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df"} err="failed to get container status \"c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df\": rpc error: code = NotFound desc = could not find container \"c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df\": container with ID starting with c09699427c329402c8341eda631edd73d8f5ddcd9d054146c3cebfa2b0cc27df not found: ID does not exist" Jul 08 15:59:45.161506 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.161474 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" path="/var/lib/kubelet/pods/0b588f0d-f38d-48d7-b612-db93098ec543/volumes" Jul 08 15:59:45.869549 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.869509 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870157 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy" containerID="cri-o://c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" gracePeriod=600 Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870183 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" gracePeriod=600 Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870178 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="thanos-sidecar" containerID="cri-o://c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" gracePeriod=600 Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870135 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="prometheus" containerID="cri-o://837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" gracePeriod=600 Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870268 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-web" containerID="cri-o://89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" gracePeriod=600 Jul 08 15:59:45.870344 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:45.870266 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="config-reloader" containerID="cri-o://7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" gracePeriod=600 Jul 08 15:59:46.121936 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.120744 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.161942 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.161899 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.161965 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.161988 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162014 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162044 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162127 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162152 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162177 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162203 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162242 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162272 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162286 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162310 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.162386 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162383 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162414 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162464 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smj9b\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162499 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162525 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162555 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets\") pod \"afa79ede-1a92-45cd-9c8d-77888c21b624\" (UID: \"afa79ede-1a92-45cd-9c8d-77888c21b624\") " Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162757 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162775 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.163147 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.162955 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.164708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.164414 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 15:59:46.164708 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.164653 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.165086 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.165019 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.165414 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.165349 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.166608 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.166401 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:46.166997 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.166936 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:46.167934 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.167900 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.168068 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.168049 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.168203 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.168178 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.168457 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.168407 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.169528 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.169488 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.170004 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.169971 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.170272 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.170245 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b" (OuterVolumeSpecName: "kube-api-access-smj9b") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "kube-api-access-smj9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:46.171660 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.171619 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config" (OuterVolumeSpecName: "config") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.171777 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.171667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out" (OuterVolumeSpecName: "config-out") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 15:59:46.171845 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.171786 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.180256 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.180227 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config" (OuterVolumeSpecName: "web-config") pod "afa79ede-1a92-45cd-9c8d-77888c21b624" (UID: "afa79ede-1a92-45cd-9c8d-77888c21b624"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:46.263275 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263249 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-web-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263275 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263272 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263283 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-metrics-client-certs\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263292 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smj9b\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-kube-api-access-smj9b\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263300 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263312 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263322 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/afa79ede-1a92-45cd-9c8d-77888c21b624-tls-assets\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263331 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-config\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263338 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-metrics-client-ca\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263346 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263354 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263362 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-grpc-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263369 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-kube-rbac-proxy\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263377 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-k8s-db\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263385 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263393 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/afa79ede-1a92-45cd-9c8d-77888c21b624-config-out\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263401 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263410 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/afa79ede-1a92-45cd-9c8d-77888c21b624-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.263460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.263418 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/afa79ede-1a92-45cd-9c8d-77888c21b624-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 15:59:46.763490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763460 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" exitCode=0 Jul 08 15:59:46.763490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763483 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" exitCode=0 Jul 08 15:59:46.763490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763491 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" exitCode=0 Jul 08 15:59:46.763490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763497 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" exitCode=0 Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763502 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" exitCode=0 Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763507 2578 generic.go:356] "Generic (PLEG): container finished" podID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" exitCode=0 Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763552 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763567 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763621 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763672 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763687 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763704 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} Jul 08 15:59:46.763748 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763737 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} Jul 08 15:59:46.764304 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.763767 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"afa79ede-1a92-45cd-9c8d-77888c21b624","Type":"ContainerDied","Data":"b18fea9454c96aa668513a3d809c12687a618d656153f01d5f749cd81638cdf1"} Jul 08 15:59:46.771478 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.771339 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.778037 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.778019 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.784164 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.784148 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.788524 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.788502 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:46.790895 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.790874 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.794397 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.794377 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:46.797964 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.797948 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.804472 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.804452 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.810276 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.810263 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.810538 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.810521 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.810599 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.810546 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.810599 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.810562 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.810780 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.810765 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.810818 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.810785 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.810818 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.810799 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.811016 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.811001 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.811059 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811023 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.811059 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811042 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.811235 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.811219 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.811273 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811239 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.811273 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811252 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.811423 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.811405 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.811490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811446 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.811490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811471 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.811711 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.811694 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.811762 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811714 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.811762 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811727 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.811961 ip-10-0-133-83 kubenswrapper[2578]: E0708 15:59:46.811942 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.812020 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811967 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.812020 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.811981 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.812221 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812194 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.812287 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812223 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.812510 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812486 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.812510 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812510 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.812756 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812736 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.812858 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.812756 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.813063 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813046 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.813063 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813062 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.813284 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813264 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.813333 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813288 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.813500 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813484 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.813560 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813501 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.813720 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813704 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.813761 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813720 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.813910 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813893 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.813956 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.813909 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.814115 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814091 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.814164 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814115 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.814320 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814306 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.814320 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814319 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.814547 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814529 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.814599 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814548 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.814735 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814718 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.814779 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814736 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.814903 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814889 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.814951 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.814903 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.815111 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815097 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.815149 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815110 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.815319 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815300 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.815363 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815320 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.815532 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815515 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.815579 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815532 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.815705 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815691 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.815755 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815705 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.815877 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815860 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.815932 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.815878 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.816075 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816059 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.816114 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816075 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.816301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816277 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.816301 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816293 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.816544 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816527 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.816607 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816545 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.816773 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816757 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.816773 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816772 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.816977 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816962 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.816977 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.816977 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.817216 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817195 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.817296 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817218 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.817472 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817449 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.817472 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817466 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.817724 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817702 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.817794 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817726 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.817950 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817936 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.818000 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.817950 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.818169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818152 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.818212 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818170 2578 scope.go:117] "RemoveContainer" containerID="fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500" Jul 08 15:59:46.818391 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818371 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500"} err="failed to get container status \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": rpc error: code = NotFound desc = could not find container \"fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500\": container with ID starting with fd773b04772707deed3b9a326843a94b65ba4597c368268ba485bb1528c65500 not found: ID does not exist" Jul 08 15:59:46.818460 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818392 2578 scope.go:117] "RemoveContainer" containerID="c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef" Jul 08 15:59:46.818648 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818633 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef"} err="failed to get container status \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": rpc error: code = NotFound desc = could not find container \"c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef\": container with ID starting with c9120b8c14cd8fd5199271b4991e92872cf22c8b2f08886f0c95b715561880ef not found: ID does not exist" Jul 08 15:59:46.818699 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818648 2578 scope.go:117] "RemoveContainer" containerID="89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b" Jul 08 15:59:46.818849 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818831 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b"} err="failed to get container status \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": rpc error: code = NotFound desc = could not find container \"89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b\": container with ID starting with 89f93b805d1e7ad918f9e056f422b9783451790983f1e59e5aad3eea4115932b not found: ID does not exist" Jul 08 15:59:46.818849 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.818848 2578 scope.go:117] "RemoveContainer" containerID="c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a" Jul 08 15:59:46.819058 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819043 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a"} err="failed to get container status \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": rpc error: code = NotFound desc = could not find container \"c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a\": container with ID starting with c1056e3aee788fbe08fd24ff15014786a6684342f15a2bd00cfcda8c378edb2a not found: ID does not exist" Jul 08 15:59:46.819100 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819059 2578 scope.go:117] "RemoveContainer" containerID="7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35" Jul 08 15:59:46.819261 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819246 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35"} err="failed to get container status \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": rpc error: code = NotFound desc = could not find container \"7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35\": container with ID starting with 7d4ff88374d07339d94ec78d3c3beff19525e10d09cf0d1d5abb9e162a5c4f35 not found: ID does not exist" Jul 08 15:59:46.819302 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819262 2578 scope.go:117] "RemoveContainer" containerID="837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f" Jul 08 15:59:46.819469 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819447 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f"} err="failed to get container status \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": rpc error: code = NotFound desc = could not find container \"837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f\": container with ID starting with 837f9f5caa2a9b7faaf91cf03384220a8243c61ca6b8b36fd937ea8040fbd25f not found: ID does not exist" Jul 08 15:59:46.819506 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819471 2578 scope.go:117] "RemoveContainer" containerID="bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458" Jul 08 15:59:46.819652 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.819637 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458"} err="failed to get container status \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": rpc error: code = NotFound desc = could not find container \"bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458\": container with ID starting with bcf4619f033938443055e29278f820b2c87e7036ce35f1e3c022094e58843458 not found: ID does not exist" Jul 08 15:59:46.821831 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.821811 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:46.822037 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822023 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="config-reloader" Jul 08 15:59:46.822080 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822041 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="config-reloader" Jul 08 15:59:46.822080 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822052 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-metric" Jul 08 15:59:46.822080 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822059 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-metric" Jul 08 15:59:46.822080 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822074 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy" Jul 08 15:59:46.822080 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822080 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822086 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="prometheus" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822092 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="prometheus" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822098 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="thanos-sidecar" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822104 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="thanos-sidecar" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822112 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="init-config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822117 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="init-config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822122 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-thanos" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822126 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-thanos" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822135 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822143 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822151 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="alertmanager" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822157 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="alertmanager" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822163 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="init-config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822167 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="init-config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822173 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822178 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822183 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822188 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="config-reloader" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822194 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822199 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822204 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="prom-label-proxy" Jul 08 15:59:46.822224 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822209 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="prom-label-proxy" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822248 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="prometheus" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822255 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="config-reloader" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822260 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-thanos" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822267 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822272 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822278 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="prom-label-proxy" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822283 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="kube-rbac-proxy-metric" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822289 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy-web" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822298 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="kube-rbac-proxy" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822305 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="alertmanager" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822309 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b588f0d-f38d-48d7-b612-db93098ec543" containerName="config-reloader" Jul 08 15:59:46.822832 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.822314 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" containerName="thanos-sidecar" Jul 08 15:59:46.826967 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.826952 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.830014 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.829993 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 15:59:46.830014 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830009 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 15:59:46.830169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830020 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 15:59:46.830169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830057 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 15:59:46.830169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830098 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 15:59:46.830169 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830107 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 15:59:46.830354 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830234 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 15:59:46.830462 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830410 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 15:59:46.830525 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830505 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 15:59:46.830579 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830552 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4to15oq6n892r\"" Jul 08 15:59:46.830625 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.830608 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 15:59:46.831265 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.831250 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 15:59:46.831353 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.831266 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 15:59:46.831353 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.831273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wgc7p\"" Jul 08 15:59:46.831353 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.831309 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 15:59:46.840025 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.839999 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 15:59:46.841187 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.841169 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 15:59:46.844176 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.844158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:46.865253 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865338 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865270 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865338 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865338 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865312 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865463 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865367 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865463 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865394 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9vwb\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-kube-api-access-k9vwb\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865463 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865417 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865509 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865565 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865557 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865615 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865634 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865689 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865714 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865885 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.865885 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.865745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966208 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966176 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966208 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966211 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966418 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966228 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966418 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966418 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966418 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966281 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966719 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966794 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966748 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966794 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966794 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966784 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966827 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966853 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966911 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.966943 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966943 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.966972 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.967006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.967032 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.967059 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.967091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.967198 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.967117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9vwb\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-kube-api-access-k9vwb\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.969312 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.969283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.969469 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.969422 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.969670 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.969627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.969670 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.969650 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.969962 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.969845 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.970104 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.970082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.970491 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.970463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972291 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972266 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972398 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972354 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-web-config\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972484 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972396 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972484 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972484 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972632 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972594 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0ce0f50-fc2a-409a-b68e-01051fd595a1-config-out\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972687 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972743 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972703 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.972797 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.972758 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a0ce0f50-fc2a-409a-b68e-01051fd595a1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.973299 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.973277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a0ce0f50-fc2a-409a-b68e-01051fd595a1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:46.976490 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:46.976474 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9vwb\" (UniqueName: \"kubernetes.io/projected/a0ce0f50-fc2a-409a-b68e-01051fd595a1-kube-api-access-k9vwb\") pod \"prometheus-k8s-0\" (UID: \"a0ce0f50-fc2a-409a-b68e-01051fd595a1\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:47.141494 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.141452 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 15:59:47.161883 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.161856 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa79ede-1a92-45cd-9c8d-77888c21b624" path="/var/lib/kubelet/pods/afa79ede-1a92-45cd-9c8d-77888c21b624/volumes" Jul 08 15:59:47.272983 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.272953 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 15:59:47.276397 ip-10-0-133-83 kubenswrapper[2578]: W0708 15:59:47.276372 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0ce0f50_fc2a_409a_b68e_01051fd595a1.slice/crio-eac09d09c3aa397902a871f6aca1f49bdff9b83303cb992a6a1d998a3630290c WatchSource:0}: Error finding container eac09d09c3aa397902a871f6aca1f49bdff9b83303cb992a6a1d998a3630290c: Status 404 returned error can't find the container with id eac09d09c3aa397902a871f6aca1f49bdff9b83303cb992a6a1d998a3630290c Jul 08 15:59:47.769354 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.769324 2578 generic.go:356] "Generic (PLEG): container finished" podID="a0ce0f50-fc2a-409a-b68e-01051fd595a1" containerID="aaa975eeff374d33c37b76fe9dbc77a50b0f18c400b2f03688b468168dfacc96" exitCode=0 Jul 08 15:59:47.769559 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.769404 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerDied","Data":"aaa975eeff374d33c37b76fe9dbc77a50b0f18c400b2f03688b468168dfacc96"} Jul 08 15:59:47.769559 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:47.769488 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"eac09d09c3aa397902a871f6aca1f49bdff9b83303cb992a6a1d998a3630290c"} Jul 08 15:59:48.777173 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777133 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"c8f5eb7682cc7822796a3d2c7b2362571d9983845a6ae5dcb88548689fbe109d"} Jul 08 15:59:48.777640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777224 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"1a3452da76a6ef2a156608f6bc5d8ee0d892ab6cf79ba27403b2957fd698a8e3"} Jul 08 15:59:48.777640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777254 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"1cd1caa42e4e84fbb64410f34f7e3762931edfc07df3bf914fec1b9895dd6448"} Jul 08 15:59:48.777640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777282 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"c3c9b6d356f91ae1bc8505dd9a6800a96f75b93e0b66b5ce2aed37bee0cf033f"} Jul 08 15:59:48.777640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777306 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"a4cb335f1f353167701ce0793ada6189252eda485e9ec1ab0a854bb4e764ae8e"} Jul 08 15:59:48.777640 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.777336 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a0ce0f50-fc2a-409a-b68e-01051fd595a1","Type":"ContainerStarted","Data":"9746993b2ef71a15474b175a7d2193048f9cb555d12ce2d00f698285088efc9c"} Jul 08 15:59:48.810250 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:48.810197 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.791637262 podStartE2EDuration="2.810179248s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.541986ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:48.80879738 +0000 UTC m=+148.310919186" watchObservedRunningTime="2026-07-08 15:59:48.810179248 +0000 UTC m=+148.312301054" Jul 08 15:59:52.142571 ip-10-0-133-83 kubenswrapper[2578]: I0708 15:59:52.142520 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 16:00:47.141961 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:00:47.141928 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 16:00:47.161251 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:00:47.161228 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 16:00:47.998728 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:00:47.998700 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 16:01:42.844806 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.844730 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb"] Jul 08 16:01:42.847143 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.847126 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:42.849658 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.849635 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 16:01:42.850974 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.850953 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 16:01:42.851056 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.851001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ptq6j\"" Jul 08 16:01:42.859229 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:42.859209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb"] Jul 08 16:01:43.030338 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.030299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnkmg\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-kube-api-access-pnkmg\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.030338 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.030352 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.131819 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.131745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnkmg\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-kube-api-access-pnkmg\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.131819 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.131785 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.141163 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.141134 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.141356 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.141333 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnkmg\" (UniqueName: \"kubernetes.io/projected/bfa34058-6782-497b-8bb0-e865c92f17ba-kube-api-access-pnkmg\") pod \"cert-manager-cainjector-559cdd8c87-b7bhb\" (UID: \"bfa34058-6782-497b-8bb0-e865c92f17ba\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.164284 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.164262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" Jul 08 16:01:43.289756 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:43.286201 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb"] Jul 08 16:01:43.292675 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:01:43.292643 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfa34058_6782_497b_8bb0_e865c92f17ba.slice/crio-288a1371b84363185ffdb47dde043d6ab11dc887017d8043c5b67ffe06c360fe WatchSource:0}: Error finding container 288a1371b84363185ffdb47dde043d6ab11dc887017d8043c5b67ffe06c360fe: Status 404 returned error can't find the container with id 288a1371b84363185ffdb47dde043d6ab11dc887017d8043c5b67ffe06c360fe Jul 08 16:01:44.167082 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:44.167052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" event={"ID":"bfa34058-6782-497b-8bb0-e865c92f17ba","Type":"ContainerStarted","Data":"288a1371b84363185ffdb47dde043d6ab11dc887017d8043c5b67ffe06c360fe"} Jul 08 16:01:47.180386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:47.180296 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" event={"ID":"bfa34058-6782-497b-8bb0-e865c92f17ba","Type":"ContainerStarted","Data":"efbb1dc98ef6f85c89b1f0b069e8ad74d73bd2e3183f99a8fe26ec95e2f5fb43"} Jul 08 16:01:47.203222 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:47.203174 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b7bhb" podStartSLOduration=1.703642135 podStartE2EDuration="5.203158531s" totalImagesPullingTime="3.499516396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:47.201044314 +0000 UTC m=+266.703166113" watchObservedRunningTime="2026-07-08 16:01:47.203158531 +0000 UTC m=+266.705280336" Jul 08 16:01:52.965570 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:52.965531 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zhxrd"] Jul 08 16:01:52.968239 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:52.968222 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:52.971548 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:52.971520 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8hcds\"" Jul 08 16:01:52.979141 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:52.979120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zhxrd"] Jul 08 16:01:53.003693 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.003670 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-bound-sa-token\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.003795 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.003697 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w225m\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-kube-api-access-w225m\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.104949 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.104915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w225m\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-kube-api-access-w225m\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.105089 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.105001 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-bound-sa-token\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.113543 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.113515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w225m\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-kube-api-access-w225m\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.113627 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.113547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2493f726-7b41-4b56-92a4-1962389c661d-bound-sa-token\") pod \"cert-manager-55b4d954d5-zhxrd\" (UID: \"2493f726-7b41-4b56-92a4-1962389c661d\") " pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.277185 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.277163 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-zhxrd" Jul 08 16:01:53.406977 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:53.406944 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-zhxrd"] Jul 08 16:01:53.410024 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:01:53.410000 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2493f726_7b41_4b56_92a4_1962389c661d.slice/crio-f5dcd3faa3e9db39a121488edf5f7ba43d42d0b6b74114b211fbcd6b7a6466f1 WatchSource:0}: Error finding container f5dcd3faa3e9db39a121488edf5f7ba43d42d0b6b74114b211fbcd6b7a6466f1: Status 404 returned error can't find the container with id f5dcd3faa3e9db39a121488edf5f7ba43d42d0b6b74114b211fbcd6b7a6466f1 Jul 08 16:01:54.203601 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:54.203566 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zhxrd" event={"ID":"2493f726-7b41-4b56-92a4-1962389c661d","Type":"ContainerStarted","Data":"5b691d55b25a3635dd7443dfa2e6bf46ae92013c0b766c05eca347d38897dfa4"} Jul 08 16:01:54.204060 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:54.203608 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-zhxrd" event={"ID":"2493f726-7b41-4b56-92a4-1962389c661d","Type":"ContainerStarted","Data":"f5dcd3faa3e9db39a121488edf5f7ba43d42d0b6b74114b211fbcd6b7a6466f1"} Jul 08 16:01:54.221364 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:01:54.221317 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-zhxrd" podStartSLOduration=2.221302886 podStartE2EDuration="2.221302886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:54.219891042 +0000 UTC m=+273.722012866" watchObservedRunningTime="2026-07-08 16:01:54.221302886 +0000 UTC m=+273.723424691" Jul 08 16:02:13.968534 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.968503 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq"] Jul 08 16:02:13.971291 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.971275 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:13.976877 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.976855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 16:02:13.977358 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.977338 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 16:02:13.977503 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.977417 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jhrsw\"" Jul 08 16:02:13.977503 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.977469 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 16:02:13.978140 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.978013 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 16:02:13.985905 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:13.985883 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq"] Jul 08 16:02:14.057517 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.057494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.057630 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.057538 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-manifests\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.057630 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.057569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-tmp\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.057630 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.057589 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frr8z\" (UniqueName: \"kubernetes.io/projected/e54c0239-1629-4eb6-93e0-dca392fd1d08-kube-api-access-frr8z\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.057728 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.057669 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158218 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158183 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158218 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158478 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158253 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-manifests\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158478 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158269 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-tmp\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158478 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158288 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frr8z\" (UniqueName: \"kubernetes.io/projected/e54c0239-1629-4eb6-93e0-dca392fd1d08-kube-api-access-frr8z\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.158782 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.158762 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-manifests\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.160543 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.160517 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e54c0239-1629-4eb6-93e0-dca392fd1d08-tmp\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.160795 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.160777 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.160858 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.160779 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e54c0239-1629-4eb6-93e0-dca392fd1d08-webhook-cert\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.174061 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.174037 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frr8z\" (UniqueName: \"kubernetes.io/projected/e54c0239-1629-4eb6-93e0-dca392fd1d08-kube-api-access-frr8z\") pod \"opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq\" (UID: \"e54c0239-1629-4eb6-93e0-dca392fd1d08\") " pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.280960 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.280940 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:14.434682 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:14.434657 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq"] Jul 08 16:02:14.436313 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:02:14.436287 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54c0239_1629_4eb6_93e0_dca392fd1d08.slice/crio-808465d0fd9508a37add587d3891f2454dfbdc68375c6829d5e1125f4d7e2767 WatchSource:0}: Error finding container 808465d0fd9508a37add587d3891f2454dfbdc68375c6829d5e1125f4d7e2767: Status 404 returned error can't find the container with id 808465d0fd9508a37add587d3891f2454dfbdc68375c6829d5e1125f4d7e2767 Jul 08 16:02:15.277666 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:15.277631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" event={"ID":"e54c0239-1629-4eb6-93e0-dca392fd1d08","Type":"ContainerStarted","Data":"808465d0fd9508a37add587d3891f2454dfbdc68375c6829d5e1125f4d7e2767"} Jul 08 16:02:18.290106 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:18.290066 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" event={"ID":"e54c0239-1629-4eb6-93e0-dca392fd1d08","Type":"ContainerStarted","Data":"b189c67591ac16cda45cc1fd838e0e4e173129aff9b99c7191b406ad792cf031"} Jul 08 16:02:19.295301 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:19.295267 2578 generic.go:356] "Generic (PLEG): container finished" podID="e54c0239-1629-4eb6-93e0-dca392fd1d08" containerID="b189c67591ac16cda45cc1fd838e0e4e173129aff9b99c7191b406ad792cf031" exitCode=0 Jul 08 16:02:19.295680 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:19.295309 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" event={"ID":"e54c0239-1629-4eb6-93e0-dca392fd1d08","Type":"ContainerDied","Data":"b189c67591ac16cda45cc1fd838e0e4e173129aff9b99c7191b406ad792cf031"} Jul 08 16:02:20.301092 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:20.301060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" event={"ID":"e54c0239-1629-4eb6-93e0-dca392fd1d08","Type":"ContainerStarted","Data":"88ffdcb5b69921c8c0e6fcde6b5bc158c2c19e9411c95259453f752da74356f4"} Jul 08 16:02:20.301468 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:20.301206 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:20.950041 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:20.950013 2578 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:02:31.306567 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:31.306538 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" Jul 08 16:02:31.338041 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:31.337993 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq" podStartSLOduration=13.456779881 podStartE2EDuration="18.337979777s" totalImagesPullingTime="3.857740644s" totalInitContainerRuntime="1.023459252s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:20.332457248 +0000 UTC m=+299.834579054" watchObservedRunningTime="2026-07-08 16:02:31.337979777 +0000 UTC m=+310.840101639" Jul 08 16:02:43.254654 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.254623 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj"] Jul 08 16:02:43.257168 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.257152 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.275733 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.275708 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 16:02:43.276965 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.276947 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 16:02:43.277076 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.277055 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 16:02:43.277143 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.277129 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hkcv9\"" Jul 08 16:02:43.277202 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.277063 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 16:02:43.277254 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.277221 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:02:43.307159 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.307136 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj"] Jul 08 16:02:43.393745 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.393711 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25b309b8-e3ad-4913-a2d6-682501149cff-manager-config\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.393745 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.393745 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-metrics-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.393963 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.393819 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrjx6\" (UniqueName: \"kubernetes.io/projected/25b309b8-e3ad-4913-a2d6-682501149cff-kube-api-access-rrjx6\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.393963 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.393864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.495098 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.495065 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrjx6\" (UniqueName: \"kubernetes.io/projected/25b309b8-e3ad-4913-a2d6-682501149cff-kube-api-access-rrjx6\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.495277 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.495114 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.495277 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.495175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25b309b8-e3ad-4913-a2d6-682501149cff-manager-config\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.495277 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.495196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-metrics-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.495844 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.495820 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/25b309b8-e3ad-4913-a2d6-682501149cff-manager-config\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.497603 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.497582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.497679 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.497635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/25b309b8-e3ad-4913-a2d6-682501149cff-metrics-cert\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.510738 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.510693 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrjx6\" (UniqueName: \"kubernetes.io/projected/25b309b8-e3ad-4913-a2d6-682501149cff-kube-api-access-rrjx6\") pod \"lws-controller-manager-6d876f9cf6-trqkj\" (UID: \"25b309b8-e3ad-4913-a2d6-682501149cff\") " pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.566346 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.566324 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:43.714953 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.714931 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj"] Jul 08 16:02:43.717569 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:02:43.717546 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b309b8_e3ad_4913_a2d6_682501149cff.slice/crio-16087caba355ae94010e5b7cae428604fd9d1100dabfcb2831b77f939dc4b38b WatchSource:0}: Error finding container 16087caba355ae94010e5b7cae428604fd9d1100dabfcb2831b77f939dc4b38b: Status 404 returned error can't find the container with id 16087caba355ae94010e5b7cae428604fd9d1100dabfcb2831b77f939dc4b38b Jul 08 16:02:43.719466 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:43.719447 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:02:44.394031 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:44.393994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" event={"ID":"25b309b8-e3ad-4913-a2d6-682501149cff","Type":"ContainerStarted","Data":"16087caba355ae94010e5b7cae428604fd9d1100dabfcb2831b77f939dc4b38b"} Jul 08 16:02:45.585690 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.585653 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc"] Jul 08 16:02:45.592105 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.592082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.603312 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.603273 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 16:02:45.603508 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.603377 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 16:02:45.603508 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.603449 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 16:02:45.605893 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.605873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 16:02:45.606026 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.606010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qc5sz\"" Jul 08 16:02:45.641688 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.641554 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc"] Jul 08 16:02:45.715783 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.715755 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tls-certs\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.715951 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.715799 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tmp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.715951 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.715842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlknp\" (UniqueName: \"kubernetes.io/projected/2952fac7-3d3a-4fe9-af92-9d573bcc80af-kube-api-access-rlknp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.817164 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.817126 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tls-certs\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.817345 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.817185 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tmp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.817345 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.817223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlknp\" (UniqueName: \"kubernetes.io/projected/2952fac7-3d3a-4fe9-af92-9d573bcc80af-kube-api-access-rlknp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.819945 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.819916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tmp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.820085 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.820013 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2952fac7-3d3a-4fe9-af92-9d573bcc80af-tls-certs\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.840392 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.840341 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlknp\" (UniqueName: \"kubernetes.io/projected/2952fac7-3d3a-4fe9-af92-9d573bcc80af-kube-api-access-rlknp\") pod \"kube-auth-proxy-ccf8d5857-tmdjc\" (UID: \"2952fac7-3d3a-4fe9-af92-9d573bcc80af\") " pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:45.902677 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:45.902649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" Jul 08 16:02:46.640523 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:02:46.640496 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2952fac7_3d3a_4fe9_af92_9d573bcc80af.slice/crio-446bfc2aa3ba03c2e45b33d753cabdd62f7578334c9c7e1d7db3d88bbb0650d7 WatchSource:0}: Error finding container 446bfc2aa3ba03c2e45b33d753cabdd62f7578334c9c7e1d7db3d88bbb0650d7: Status 404 returned error can't find the container with id 446bfc2aa3ba03c2e45b33d753cabdd62f7578334c9c7e1d7db3d88bbb0650d7 Jul 08 16:02:46.657743 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:46.657718 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc"] Jul 08 16:02:47.408910 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:47.408873 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" event={"ID":"25b309b8-e3ad-4913-a2d6-682501149cff","Type":"ContainerStarted","Data":"a598b64b5c41784c5295b722ae52492abb00fcf0f3293e4637445b1814ffc91b"} Jul 08 16:02:47.409097 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:47.408962 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:02:47.409997 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:47.409978 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" event={"ID":"2952fac7-3d3a-4fe9-af92-9d573bcc80af","Type":"ContainerStarted","Data":"446bfc2aa3ba03c2e45b33d753cabdd62f7578334c9c7e1d7db3d88bbb0650d7"} Jul 08 16:02:50.424467 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:50.424417 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" event={"ID":"2952fac7-3d3a-4fe9-af92-9d573bcc80af","Type":"ContainerStarted","Data":"4b0731a88dba562b0572ebdcc575ab7fbfd08d52717a8fef9fff13d1b24698cb"} Jul 08 16:02:50.473803 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:50.473750 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" podStartSLOduration=4.645924679 podStartE2EDuration="7.473734469s" totalImagesPullingTime="2.82780979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:47.442267256 +0000 UTC m=+326.944389061" watchObservedRunningTime="2026-07-08 16:02:50.473734469 +0000 UTC m=+329.975856274" Jul 08 16:02:50.473990 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:50.473849 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-ccf8d5857-tmdjc" podStartSLOduration=2.546750295 podStartE2EDuration="5.473840855s" totalImagesPullingTime="2.92709056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:50.473514433 +0000 UTC m=+329.975636239" watchObservedRunningTime="2026-07-08 16:02:50.473840855 +0000 UTC m=+329.975962664" Jul 08 16:02:58.416877 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:02:58.416844 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6d876f9cf6-trqkj" Jul 08 16:04:07.334474 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.334423 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2"] Jul 08 16:04:07.338362 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.338340 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:07.341879 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.341855 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 16:04:07.342113 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.342096 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kt57l\"" Jul 08 16:04:07.342499 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.342482 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 16:04:07.342962 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.342947 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 16:04:07.353761 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.353742 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2"] Jul 08 16:04:07.439003 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.438975 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smccd\" (UniqueName: \"kubernetes.io/projected/01fd30e5-62a6-441c-a9d1-a7d1bc8178e9-kube-api-access-smccd\") pod \"dns-operator-controller-manager-864dd78c4c-5kpk2\" (UID: \"01fd30e5-62a6-441c-a9d1-a7d1bc8178e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:07.539927 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.539892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smccd\" (UniqueName: \"kubernetes.io/projected/01fd30e5-62a6-441c-a9d1-a7d1bc8178e9-kube-api-access-smccd\") pod \"dns-operator-controller-manager-864dd78c4c-5kpk2\" (UID: \"01fd30e5-62a6-441c-a9d1-a7d1bc8178e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:07.554498 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.554467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smccd\" (UniqueName: \"kubernetes.io/projected/01fd30e5-62a6-441c-a9d1-a7d1bc8178e9-kube-api-access-smccd\") pod \"dns-operator-controller-manager-864dd78c4c-5kpk2\" (UID: \"01fd30e5-62a6-441c-a9d1-a7d1bc8178e9\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:07.651173 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.651097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:07.779734 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:07.779703 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2"] Jul 08 16:04:07.782723 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:04:07.782698 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fd30e5_62a6_441c_a9d1_a7d1bc8178e9.slice/crio-ee6dcc7efa82a4fa2ebc27792cc034c392b734d6c8e8530ec48af025214b4cfb WatchSource:0}: Error finding container ee6dcc7efa82a4fa2ebc27792cc034c392b734d6c8e8530ec48af025214b4cfb: Status 404 returned error can't find the container with id ee6dcc7efa82a4fa2ebc27792cc034c392b734d6c8e8530ec48af025214b4cfb Jul 08 16:04:08.709937 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:08.709897 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" event={"ID":"01fd30e5-62a6-441c-a9d1-a7d1bc8178e9","Type":"ContainerStarted","Data":"ee6dcc7efa82a4fa2ebc27792cc034c392b734d6c8e8530ec48af025214b4cfb"} Jul 08 16:04:10.719856 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:10.719819 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" event={"ID":"01fd30e5-62a6-441c-a9d1-a7d1bc8178e9","Type":"ContainerStarted","Data":"1a99b3109ea34cae680b38c7e36d7f4e6d2d9d2e82eba0f50927818c01f72bf3"} Jul 08 16:04:10.720249 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:10.719967 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:10.737941 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:10.737872 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" podStartSLOduration=1.504727733 podStartE2EDuration="3.737858971s" totalImagesPullingTime="2.233131238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:10.73707374 +0000 UTC m=+410.239195555" watchObservedRunningTime="2026-07-08 16:04:10.737858971 +0000 UTC m=+410.239980776" Jul 08 16:04:15.328273 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.328234 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx"] Jul 08 16:04:15.330641 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.330624 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.333265 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.333234 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 16:04:15.333265 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.333256 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 16:04:15.333510 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.333496 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zdtzt\"" Jul 08 16:04:15.339947 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.339927 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx"] Jul 08 16:04:15.400631 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.400598 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2dbf45a5-00b1-41c3-9770-13f6eac97371-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.400768 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.400644 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvvww\" (UniqueName: \"kubernetes.io/projected/2dbf45a5-00b1-41c3-9770-13f6eac97371-kube-api-access-wvvww\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.400768 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.400682 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dbf45a5-00b1-41c3-9770-13f6eac97371-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.501227 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.501195 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2dbf45a5-00b1-41c3-9770-13f6eac97371-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.501376 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.501236 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvvww\" (UniqueName: \"kubernetes.io/projected/2dbf45a5-00b1-41c3-9770-13f6eac97371-kube-api-access-wvvww\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.501376 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.501265 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dbf45a5-00b1-41c3-9770-13f6eac97371-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.501844 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.501826 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2dbf45a5-00b1-41c3-9770-13f6eac97371-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.503591 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.503574 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2dbf45a5-00b1-41c3-9770-13f6eac97371-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.510820 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.510795 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvvww\" (UniqueName: \"kubernetes.io/projected/2dbf45a5-00b1-41c3-9770-13f6eac97371-kube-api-access-wvvww\") pod \"kuadrant-console-plugin-66b5774985-b8dtx\" (UID: \"2dbf45a5-00b1-41c3-9770-13f6eac97371\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.639236 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.639166 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" Jul 08 16:04:15.764096 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:15.763952 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx"] Jul 08 16:04:15.766661 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:04:15.766630 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dbf45a5_00b1_41c3_9770_13f6eac97371.slice/crio-daa15d36ccdf45b149f6cc974669802f3e2cd1e2aa1276f1f88eb4b22ea10390 WatchSource:0}: Error finding container daa15d36ccdf45b149f6cc974669802f3e2cd1e2aa1276f1f88eb4b22ea10390: Status 404 returned error can't find the container with id daa15d36ccdf45b149f6cc974669802f3e2cd1e2aa1276f1f88eb4b22ea10390 Jul 08 16:04:16.746378 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:16.746334 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" event={"ID":"2dbf45a5-00b1-41c3-9770-13f6eac97371","Type":"ContainerStarted","Data":"daa15d36ccdf45b149f6cc974669802f3e2cd1e2aa1276f1f88eb4b22ea10390"} Jul 08 16:04:21.726788 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:21.726759 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-5kpk2" Jul 08 16:04:39.848472 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:39.848368 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" event={"ID":"2dbf45a5-00b1-41c3-9770-13f6eac97371","Type":"ContainerStarted","Data":"ac0b28fd1ed995afe4e23a146e7244dfc13d927cf30e9351a1762a845df60a4a"} Jul 08 16:04:39.867604 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:39.867557 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-b8dtx" podStartSLOduration=1.089581305 podStartE2EDuration="24.867540605s" totalImagesPullingTime="23.7779593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:39.865553628 +0000 UTC m=+439.367675448" watchObservedRunningTime="2026-07-08 16:04:39.867540605 +0000 UTC m=+439.369662410" Jul 08 16:04:56.465472 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.465371 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:04:56.533765 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.533731 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:04:56.533909 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.533840 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.536648 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.536622 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 16:04:56.552954 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.552930 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxbv\" (UniqueName: \"kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.553064 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.552980 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.568316 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.568290 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:04:56.653945 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.653922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxbv\" (UniqueName: \"kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.654078 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.653968 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.654674 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.654653 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.663936 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.663910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxbv\" (UniqueName: \"kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv\") pod \"limitador-limitador-64c94fd64f-9grk2\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.846032 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.845996 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:04:56.972073 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:56.972045 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:04:56.974386 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:04:56.974358 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245b52a0_c26e_48aa_9cd4_7848654b5b09.slice/crio-0b624b4212348a3c50c0f85328a425f0e4e5dbe08ab7cd1ebd81c001492c3487 WatchSource:0}: Error finding container 0b624b4212348a3c50c0f85328a425f0e4e5dbe08ab7cd1ebd81c001492c3487: Status 404 returned error can't find the container with id 0b624b4212348a3c50c0f85328a425f0e4e5dbe08ab7cd1ebd81c001492c3487 Jul 08 16:04:57.275934 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.275904 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:04:57.279125 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.279105 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:04:57.281851 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.281832 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fjsss\"" Jul 08 16:04:57.286940 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.286901 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:04:57.358503 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.358475 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5nrb\" (UniqueName: \"kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb\") pod \"authorino-58cd955675-qdkks\" (UID: \"222b9692-cb30-44cf-8935-67eb566309e3\") " pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:04:57.459499 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.459472 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5nrb\" (UniqueName: \"kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb\") pod \"authorino-58cd955675-qdkks\" (UID: \"222b9692-cb30-44cf-8935-67eb566309e3\") " pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:04:57.469287 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.469265 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5nrb\" (UniqueName: \"kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb\") pod \"authorino-58cd955675-qdkks\" (UID: \"222b9692-cb30-44cf-8935-67eb566309e3\") " pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:04:57.589061 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.588937 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:04:57.604991 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.604958 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:04:57.607908 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.607884 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:04:57.616883 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.616855 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:04:57.763513 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.763405 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mntcf\" (UniqueName: \"kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf\") pod \"authorino-75d556bd77-pxv8b\" (UID: \"3a21823d-2897-4065-8b59-f3fecc3fc811\") " pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:04:57.779247 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.779216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:04:57.864263 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.864184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mntcf\" (UniqueName: \"kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf\") pod \"authorino-75d556bd77-pxv8b\" (UID: \"3a21823d-2897-4065-8b59-f3fecc3fc811\") " pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:04:57.874802 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.874750 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mntcf\" (UniqueName: \"kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf\") pod \"authorino-75d556bd77-pxv8b\" (UID: \"3a21823d-2897-4065-8b59-f3fecc3fc811\") " pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:04:57.921903 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.921866 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qdkks" event={"ID":"222b9692-cb30-44cf-8935-67eb566309e3","Type":"ContainerStarted","Data":"db75000596ea570a734ecaa91b7c0853c9c898f91e8f90ad693df3fc233a973d"} Jul 08 16:04:57.923160 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.923127 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" event={"ID":"245b52a0-c26e-48aa-9cd4-7848654b5b09","Type":"ContainerStarted","Data":"0b624b4212348a3c50c0f85328a425f0e4e5dbe08ab7cd1ebd81c001492c3487"} Jul 08 16:04:57.925251 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:57.925233 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:04:58.069068 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:58.068916 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:04:58.071690 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:04:58.071663 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a21823d_2897_4065_8b59_f3fecc3fc811.slice/crio-120b253aeffa3a55a8a68e9fd09d501d854be82d1720a62deb081daa9498019e WatchSource:0}: Error finding container 120b253aeffa3a55a8a68e9fd09d501d854be82d1720a62deb081daa9498019e: Status 404 returned error can't find the container with id 120b253aeffa3a55a8a68e9fd09d501d854be82d1720a62deb081daa9498019e Jul 08 16:04:58.932112 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:04:58.932048 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pxv8b" event={"ID":"3a21823d-2897-4065-8b59-f3fecc3fc811","Type":"ContainerStarted","Data":"120b253aeffa3a55a8a68e9fd09d501d854be82d1720a62deb081daa9498019e"} Jul 08 16:05:01.948548 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.948414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pxv8b" event={"ID":"3a21823d-2897-4065-8b59-f3fecc3fc811","Type":"ContainerStarted","Data":"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620"} Jul 08 16:05:01.949987 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.949955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qdkks" event={"ID":"222b9692-cb30-44cf-8935-67eb566309e3","Type":"ContainerStarted","Data":"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5"} Jul 08 16:05:01.951290 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.951266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" event={"ID":"245b52a0-c26e-48aa-9cd4-7848654b5b09","Type":"ContainerStarted","Data":"0fc8728f2a76d94deb1600e0909ae341e0bcb47d8f3cf471f8db7067861dcc6c"} Jul 08 16:05:01.951390 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.951349 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:05:01.965348 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.965298 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-pxv8b" podStartSLOduration=1.377413029 podStartE2EDuration="4.965282628s" totalImagesPullingTime="3.587869599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:01.964655325 +0000 UTC m=+461.466777151" watchObservedRunningTime="2026-07-08 16:05:01.965282628 +0000 UTC m=+461.467404433" Jul 08 16:05:01.983868 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.983804 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" podStartSLOduration=1.375992479 podStartE2EDuration="5.983781085s" totalImagesPullingTime="4.607788606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:01.981902569 +0000 UTC m=+461.484024407" watchObservedRunningTime="2026-07-08 16:05:01.983781085 +0000 UTC m=+461.485902890" Jul 08 16:05:01.998459 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:01.998415 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:05:02.022987 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:02.022938 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qdkks" podStartSLOduration=1.1578299730000001 podStartE2EDuration="5.022922622s" totalImagesPullingTime="3.865092649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:02.022471843 +0000 UTC m=+461.524593670" watchObservedRunningTime="2026-07-08 16:05:02.022922622 +0000 UTC m=+461.525044428" Jul 08 16:05:03.959868 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:03.959829 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qdkks" podUID="222b9692-cb30-44cf-8935-67eb566309e3" containerName="authorino" containerID="cri-o://9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5" gracePeriod=30 Jul 08 16:05:04.197971 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.197949 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:05:04.212258 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.212207 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5nrb\" (UniqueName: \"kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb\") pod \"222b9692-cb30-44cf-8935-67eb566309e3\" (UID: \"222b9692-cb30-44cf-8935-67eb566309e3\") " Jul 08 16:05:04.214353 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.214318 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb" (OuterVolumeSpecName: "kube-api-access-b5nrb") pod "222b9692-cb30-44cf-8935-67eb566309e3" (UID: "222b9692-cb30-44cf-8935-67eb566309e3"). InnerVolumeSpecName "kube-api-access-b5nrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:04.313769 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.313737 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5nrb\" (UniqueName: \"kubernetes.io/projected/222b9692-cb30-44cf-8935-67eb566309e3-kube-api-access-b5nrb\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:05:04.964989 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.964950 2578 generic.go:356] "Generic (PLEG): container finished" podID="222b9692-cb30-44cf-8935-67eb566309e3" containerID="9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5" exitCode=0 Jul 08 16:05:04.965396 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.964997 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qdkks" Jul 08 16:05:04.965396 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.965041 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qdkks" event={"ID":"222b9692-cb30-44cf-8935-67eb566309e3","Type":"ContainerDied","Data":"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5"} Jul 08 16:05:04.965396 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.965079 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qdkks" event={"ID":"222b9692-cb30-44cf-8935-67eb566309e3","Type":"ContainerDied","Data":"db75000596ea570a734ecaa91b7c0853c9c898f91e8f90ad693df3fc233a973d"} Jul 08 16:05:04.965396 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.965099 2578 scope.go:117] "RemoveContainer" containerID="9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5" Jul 08 16:05:04.973650 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.973628 2578 scope.go:117] "RemoveContainer" containerID="9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5" Jul 08 16:05:04.973918 ip-10-0-133-83 kubenswrapper[2578]: E0708 16:05:04.973900 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5\": container with ID starting with 9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5 not found: ID does not exist" containerID="9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5" Jul 08 16:05:04.973984 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.973931 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5"} err="failed to get container status \"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5\": rpc error: code = NotFound desc = could not find container \"9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5\": container with ID starting with 9fb9d966d8eb931cec30a5044e413b552265d5579214c22b366cc2325918c5c5 not found: ID does not exist" Jul 08 16:05:04.986493 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.986468 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:05:04.992552 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:04.992531 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qdkks"] Jul 08 16:05:05.163217 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:05.163183 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="222b9692-cb30-44cf-8935-67eb566309e3" path="/var/lib/kubelet/pods/222b9692-cb30-44cf-8935-67eb566309e3/volumes" Jul 08 16:05:11.473446 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:11.473394 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:05:11.473851 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:11.473603 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" podUID="245b52a0-c26e-48aa-9cd4-7848654b5b09" containerName="limitador" containerID="cri-o://0fc8728f2a76d94deb1600e0909ae341e0bcb47d8f3cf471f8db7067861dcc6c" gracePeriod=30 Jul 08 16:05:11.474355 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:11.474335 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:05:11.994309 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:11.994272 2578 generic.go:356] "Generic (PLEG): container finished" podID="245b52a0-c26e-48aa-9cd4-7848654b5b09" containerID="0fc8728f2a76d94deb1600e0909ae341e0bcb47d8f3cf471f8db7067861dcc6c" exitCode=0 Jul 08 16:05:11.994496 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:11.994314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" event={"ID":"245b52a0-c26e-48aa-9cd4-7848654b5b09","Type":"ContainerDied","Data":"0fc8728f2a76d94deb1600e0909ae341e0bcb47d8f3cf471f8db7067861dcc6c"} Jul 08 16:05:12.415310 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.415289 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:05:12.479576 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.479547 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file\") pod \"245b52a0-c26e-48aa-9cd4-7848654b5b09\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " Jul 08 16:05:12.479576 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.479580 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zxbv\" (UniqueName: \"kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv\") pod \"245b52a0-c26e-48aa-9cd4-7848654b5b09\" (UID: \"245b52a0-c26e-48aa-9cd4-7848654b5b09\") " Jul 08 16:05:12.479958 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.479902 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file" (OuterVolumeSpecName: "config-file") pod "245b52a0-c26e-48aa-9cd4-7848654b5b09" (UID: "245b52a0-c26e-48aa-9cd4-7848654b5b09"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:05:12.481616 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.481588 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv" (OuterVolumeSpecName: "kube-api-access-5zxbv") pod "245b52a0-c26e-48aa-9cd4-7848654b5b09" (UID: "245b52a0-c26e-48aa-9cd4-7848654b5b09"). InnerVolumeSpecName "kube-api-access-5zxbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:12.580805 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.580722 2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/245b52a0-c26e-48aa-9cd4-7848654b5b09-config-file\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:05:12.580805 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.580758 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zxbv\" (UniqueName: \"kubernetes.io/projected/245b52a0-c26e-48aa-9cd4-7848654b5b09-kube-api-access-5zxbv\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:05:12.999774 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.999708 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" Jul 08 16:05:12.999774 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.999726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9grk2" event={"ID":"245b52a0-c26e-48aa-9cd4-7848654b5b09","Type":"ContainerDied","Data":"0b624b4212348a3c50c0f85328a425f0e4e5dbe08ab7cd1ebd81c001492c3487"} Jul 08 16:05:12.999952 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:12.999782 2578 scope.go:117] "RemoveContainer" containerID="0fc8728f2a76d94deb1600e0909ae341e0bcb47d8f3cf471f8db7067861dcc6c" Jul 08 16:05:13.020424 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:13.020397 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:05:13.026458 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:13.026417 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9grk2"] Jul 08 16:05:13.167202 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:13.167170 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245b52a0-c26e-48aa-9cd4-7848654b5b09" path="/var/lib/kubelet/pods/245b52a0-c26e-48aa-9cd4-7848654b5b09/volumes" Jul 08 16:05:18.126515 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.126478 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh"] Jul 08 16:05:18.126913 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.126890 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245b52a0-c26e-48aa-9cd4-7848654b5b09" containerName="limitador" Jul 08 16:05:18.126913 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.126906 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="245b52a0-c26e-48aa-9cd4-7848654b5b09" containerName="limitador" Jul 08 16:05:18.127031 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.126922 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="222b9692-cb30-44cf-8935-67eb566309e3" containerName="authorino" Jul 08 16:05:18.127031 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.126931 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="222b9692-cb30-44cf-8935-67eb566309e3" containerName="authorino" Jul 08 16:05:18.127031 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.127010 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="245b52a0-c26e-48aa-9cd4-7848654b5b09" containerName="limitador" Jul 08 16:05:18.127031 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.127022 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="222b9692-cb30-44cf-8935-67eb566309e3" containerName="authorino" Jul 08 16:05:18.129585 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.129568 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.132617 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.132595 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 16:05:18.132749 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.132719 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 16:05:18.133757 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.133738 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-g8fx2\"" Jul 08 16:05:18.133870 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.133782 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 16:05:18.143141 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.143120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh"] Jul 08 16:05:18.223791 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.223756 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-data\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.223949 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.223856 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26st2\" (UniqueName: \"kubernetes.io/projected/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-kube-api-access-26st2\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.325198 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.325171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26st2\" (UniqueName: \"kubernetes.io/projected/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-kube-api-access-26st2\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.325331 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.325223 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-data\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.325581 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.325565 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-data\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.334501 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.334472 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26st2\" (UniqueName: \"kubernetes.io/projected/ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6-kube-api-access-26st2\") pod \"postgres-69fb4594cf-8pnrh\" (UID: \"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.440006 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.439922 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:18.565863 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:18.565840 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh"] Jul 08 16:05:18.568033 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:05:18.568009 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebeae06e_2f73_4ca0_9d20_dd13f3afd6d6.slice/crio-58290e6a61afec5d6f871628c55b720a6cd5542fcf3c29b055df9d2d28cf0d32 WatchSource:0}: Error finding container 58290e6a61afec5d6f871628c55b720a6cd5542fcf3c29b055df9d2d28cf0d32: Status 404 returned error can't find the container with id 58290e6a61afec5d6f871628c55b720a6cd5542fcf3c29b055df9d2d28cf0d32 Jul 08 16:05:19.024713 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:19.024675 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" event={"ID":"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6","Type":"ContainerStarted","Data":"58290e6a61afec5d6f871628c55b720a6cd5542fcf3c29b055df9d2d28cf0d32"} Jul 08 16:05:23.465146 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:23.465124 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 16:05:24.052920 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:24.052880 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" event={"ID":"ebeae06e-2f73-4ca0-9d20-dd13f3afd6d6","Type":"ContainerStarted","Data":"5467074a9472a6a49c43349d5ce51d740628d7e1094c7f8b0b710362483c3f5e"} Jul 08 16:05:24.053119 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:24.052948 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:24.070192 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:24.070143 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" podStartSLOduration=1.177347383 podStartE2EDuration="6.070127213s" totalImagesPullingTime="4.89277983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:24.069358944 +0000 UTC m=+483.571480748" watchObservedRunningTime="2026-07-08 16:05:24.070127213 +0000 UTC m=+483.572249018" Jul 08 16:05:30.087208 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.087176 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8pnrh" Jul 08 16:05:30.679265 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.679232 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:30.683782 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.683768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:30.690945 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.690922 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:30.729732 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.729705 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6xr\" (UniqueName: \"kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr\") pod \"authorino-5d4b67c446-42b9n\" (UID: \"b9ec6f28-bb3d-4c5a-b90e-7783afa60274\") " pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:30.830935 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.830904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6xr\" (UniqueName: \"kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr\") pod \"authorino-5d4b67c446-42b9n\" (UID: \"b9ec6f28-bb3d-4c5a-b90e-7783afa60274\") " pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:30.843690 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.843659 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6xr\" (UniqueName: \"kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr\") pod \"authorino-5d4b67c446-42b9n\" (UID: \"b9ec6f28-bb3d-4c5a-b90e-7783afa60274\") " pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:30.877199 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.877171 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:30.877400 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.877389 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:30.907510 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.907483 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:05:30.911167 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.911143 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:30.913879 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.913860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 16:05:30.918787 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:30.918766 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:05:31.007995 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.007970 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:31.010258 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:05:31.010232 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9ec6f28_bb3d_4c5a_b90e_7783afa60274.slice/crio-c2d24cdc3e1c4134908d7165ce8a01aa5b17560c1faa17082e1d38c8d8a47943 WatchSource:0}: Error finding container c2d24cdc3e1c4134908d7165ce8a01aa5b17560c1faa17082e1d38c8d8a47943: Status 404 returned error can't find the container with id c2d24cdc3e1c4134908d7165ce8a01aa5b17560c1faa17082e1d38c8d8a47943 Jul 08 16:05:31.033249 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.033228 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbh5\" (UniqueName: \"kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.033341 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.033259 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.081520 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.081491 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-42b9n" event={"ID":"b9ec6f28-bb3d-4c5a-b90e-7783afa60274","Type":"ContainerStarted","Data":"c2d24cdc3e1c4134908d7165ce8a01aa5b17560c1faa17082e1d38c8d8a47943"} Jul 08 16:05:31.134494 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.134471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbh5\" (UniqueName: \"kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.134908 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.134513 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.137035 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.137014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.143890 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.143863 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbh5\" (UniqueName: \"kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5\") pod \"authorino-85bff497df-rttr9\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.223761 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.223688 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:05:31.346666 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:31.346595 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:05:31.348697 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:05:31.348675 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bf723aa_717f_438d_a391_0a6ed8fab171.slice/crio-4c7bc6266ce8128129462b47723d7860185e4335d9348a4c5106dfde17b14980 WatchSource:0}: Error finding container 4c7bc6266ce8128129462b47723d7860185e4335d9348a4c5106dfde17b14980: Status 404 returned error can't find the container with id 4c7bc6266ce8128129462b47723d7860185e4335d9348a4c5106dfde17b14980 Jul 08 16:05:32.086676 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.086631 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-42b9n" event={"ID":"b9ec6f28-bb3d-4c5a-b90e-7783afa60274","Type":"ContainerStarted","Data":"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f"} Jul 08 16:05:32.086676 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.086650 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-42b9n" podUID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" containerName="authorino" containerID="cri-o://110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f" gracePeriod=30 Jul 08 16:05:32.088170 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.088148 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bff497df-rttr9" event={"ID":"4bf723aa-717f-438d-a391-0a6ed8fab171","Type":"ContainerStarted","Data":"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8"} Jul 08 16:05:32.088267 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.088180 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bff497df-rttr9" event={"ID":"4bf723aa-717f-438d-a391-0a6ed8fab171","Type":"ContainerStarted","Data":"4c7bc6266ce8128129462b47723d7860185e4335d9348a4c5106dfde17b14980"} Jul 08 16:05:32.104166 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.104127 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-42b9n" podStartSLOduration=1.674547394 podStartE2EDuration="2.104113878s" totalImagesPullingTime="429.566484ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:32.103406906 +0000 UTC m=+491.605528735" watchObservedRunningTime="2026-07-08 16:05:32.104113878 +0000 UTC m=+491.606235683" Jul 08 16:05:32.121057 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.121015 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85bff497df-rttr9" podStartSLOduration=1.732107112 podStartE2EDuration="2.120997593s" totalImagesPullingTime="388.890481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:32.12052723 +0000 UTC m=+491.622649034" watchObservedRunningTime="2026-07-08 16:05:32.120997593 +0000 UTC m=+491.623119399" Jul 08 16:05:32.150398 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.150374 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:05:32.150728 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.150547 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-pxv8b" podUID="3a21823d-2897-4065-8b59-f3fecc3fc811" containerName="authorino" containerID="cri-o://d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620" gracePeriod=30 Jul 08 16:05:32.409631 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.409612 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:32.411833 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.411816 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:05:32.548013 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.547984 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7n6xr\" (UniqueName: \"kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr\") pod \"b9ec6f28-bb3d-4c5a-b90e-7783afa60274\" (UID: \"b9ec6f28-bb3d-4c5a-b90e-7783afa60274\") " Jul 08 16:05:32.548013 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.548019 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mntcf\" (UniqueName: \"kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf\") pod \"3a21823d-2897-4065-8b59-f3fecc3fc811\" (UID: \"3a21823d-2897-4065-8b59-f3fecc3fc811\") " Jul 08 16:05:32.550024 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.549994 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr" (OuterVolumeSpecName: "kube-api-access-7n6xr") pod "b9ec6f28-bb3d-4c5a-b90e-7783afa60274" (UID: "b9ec6f28-bb3d-4c5a-b90e-7783afa60274"). InnerVolumeSpecName "kube-api-access-7n6xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:32.550105 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.550024 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf" (OuterVolumeSpecName: "kube-api-access-mntcf") pod "3a21823d-2897-4065-8b59-f3fecc3fc811" (UID: "3a21823d-2897-4065-8b59-f3fecc3fc811"). InnerVolumeSpecName "kube-api-access-mntcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:05:32.648634 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.648545 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7n6xr\" (UniqueName: \"kubernetes.io/projected/b9ec6f28-bb3d-4c5a-b90e-7783afa60274-kube-api-access-7n6xr\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:05:32.648634 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:32.648584 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mntcf\" (UniqueName: \"kubernetes.io/projected/3a21823d-2897-4065-8b59-f3fecc3fc811-kube-api-access-mntcf\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:05:33.093415 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.093383 2578 generic.go:356] "Generic (PLEG): container finished" podID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" containerID="110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f" exitCode=0 Jul 08 16:05:33.093645 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.093446 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-42b9n" Jul 08 16:05:33.093645 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.093474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-42b9n" event={"ID":"b9ec6f28-bb3d-4c5a-b90e-7783afa60274","Type":"ContainerDied","Data":"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f"} Jul 08 16:05:33.093645 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.093523 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-42b9n" event={"ID":"b9ec6f28-bb3d-4c5a-b90e-7783afa60274","Type":"ContainerDied","Data":"c2d24cdc3e1c4134908d7165ce8a01aa5b17560c1faa17082e1d38c8d8a47943"} Jul 08 16:05:33.093645 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.093541 2578 scope.go:117] "RemoveContainer" containerID="110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f" Jul 08 16:05:33.094810 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.094792 2578 generic.go:356] "Generic (PLEG): container finished" podID="3a21823d-2897-4065-8b59-f3fecc3fc811" containerID="d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620" exitCode=0 Jul 08 16:05:33.094898 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.094850 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-pxv8b" Jul 08 16:05:33.094898 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.094878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pxv8b" event={"ID":"3a21823d-2897-4065-8b59-f3fecc3fc811","Type":"ContainerDied","Data":"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620"} Jul 08 16:05:33.094998 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.094934 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-pxv8b" event={"ID":"3a21823d-2897-4065-8b59-f3fecc3fc811","Type":"ContainerDied","Data":"120b253aeffa3a55a8a68e9fd09d501d854be82d1720a62deb081daa9498019e"} Jul 08 16:05:33.103376 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.103330 2578 scope.go:117] "RemoveContainer" containerID="110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f" Jul 08 16:05:33.106060 ip-10-0-133-83 kubenswrapper[2578]: E0708 16:05:33.105906 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f\": container with ID starting with 110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f not found: ID does not exist" containerID="110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f" Jul 08 16:05:33.106060 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.105944 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f"} err="failed to get container status \"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f\": rpc error: code = NotFound desc = could not find container \"110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f\": container with ID starting with 110eeb46f2a204765e5f57c29cf4722423d29e1eaca440378686ae8e6117ba9f not found: ID does not exist" Jul 08 16:05:33.106060 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.105967 2578 scope.go:117] "RemoveContainer" containerID="d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620" Jul 08 16:05:33.115251 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.115234 2578 scope.go:117] "RemoveContainer" containerID="d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620" Jul 08 16:05:33.115537 ip-10-0-133-83 kubenswrapper[2578]: E0708 16:05:33.115514 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620\": container with ID starting with d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620 not found: ID does not exist" containerID="d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620" Jul 08 16:05:33.115607 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.115546 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620"} err="failed to get container status \"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620\": rpc error: code = NotFound desc = could not find container \"d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620\": container with ID starting with d3f17e3ab73f73c2eaae7bb5ca9c81199b5af42ad7f1b27ab2b7833955e89620 not found: ID does not exist" Jul 08 16:05:33.134443 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.134414 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:33.138269 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.138250 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-42b9n"] Jul 08 16:05:33.162744 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.162724 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" path="/var/lib/kubelet/pods/b9ec6f28-bb3d-4c5a-b90e-7783afa60274/volumes" Jul 08 16:05:33.163036 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.162952 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:05:33.163036 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:33.162971 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-pxv8b"] Jul 08 16:05:35.162281 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:35.162254 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a21823d-2897-4065-8b59-f3fecc3fc811" path="/var/lib/kubelet/pods/3a21823d-2897-4065-8b59-f3fecc3fc811/volumes" Jul 08 16:05:36.482137 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482107 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59448bbd4f-8g9mx"] Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482390 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" containerName="authorino" Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482400 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" containerName="authorino" Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482417 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a21823d-2897-4065-8b59-f3fecc3fc811" containerName="authorino" Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482422 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a21823d-2897-4065-8b59-f3fecc3fc811" containerName="authorino" Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482496 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9ec6f28-bb3d-4c5a-b90e-7783afa60274" containerName="authorino" Jul 08 16:05:36.482504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.482504 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a21823d-2897-4065-8b59-f3fecc3fc811" containerName="authorino" Jul 08 16:05:36.686120 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.686091 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59448bbd4f-8g9mx"] Jul 08 16:05:36.686280 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.686197 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.689361 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.689343 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 16:05:36.690488 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.690473 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 16:05:36.690488 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.690484 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9sb8f\"" Jul 08 16:05:36.783196 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.783172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-webhook-cert\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.783329 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.783223 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56k4g\" (UniqueName: \"kubernetes.io/projected/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-kube-api-access-56k4g\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.884310 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.884274 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-webhook-cert\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.884473 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.884337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56k4g\" (UniqueName: \"kubernetes.io/projected/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-kube-api-access-56k4g\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.886630 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.886603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-webhook-cert\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.893568 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.893547 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56k4g\" (UniqueName: \"kubernetes.io/projected/33bb27a9-71fa-46c9-b11f-1779d25ba7b3-kube-api-access-56k4g\") pod \"maas-controller-59448bbd4f-8g9mx\" (UID: \"33bb27a9-71fa-46c9-b11f-1779d25ba7b3\") " pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:36.995702 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:36.995670 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:37.152411 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:37.152380 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59448bbd4f-8g9mx"] Jul 08 16:05:37.154997 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:05:37.154972 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33bb27a9_71fa_46c9_b11f_1779d25ba7b3.slice/crio-46daa09caa34a331c1be0783ed890e0ede028b94391771b9fccd3a0a1551c72a WatchSource:0}: Error finding container 46daa09caa34a331c1be0783ed890e0ede028b94391771b9fccd3a0a1551c72a: Status 404 returned error can't find the container with id 46daa09caa34a331c1be0783ed890e0ede028b94391771b9fccd3a0a1551c72a Jul 08 16:05:38.121630 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:38.121589 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" event={"ID":"33bb27a9-71fa-46c9-b11f-1779d25ba7b3","Type":"ContainerStarted","Data":"46daa09caa34a331c1be0783ed890e0ede028b94391771b9fccd3a0a1551c72a"} Jul 08 16:05:40.131381 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:40.131345 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" event={"ID":"33bb27a9-71fa-46c9-b11f-1779d25ba7b3","Type":"ContainerStarted","Data":"d6772993667d64f6579cfc70096ecf0149706fdef9c39efdb1a66efd5836542b"} Jul 08 16:05:40.131894 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:40.131482 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:05:40.151035 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:40.150992 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" podStartSLOduration=2.222927195 podStartE2EDuration="4.150977381s" totalImagesPullingTime="1.928050186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:40.149487739 +0000 UTC m=+499.651609571" watchObservedRunningTime="2026-07-08 16:05:40.150977381 +0000 UTC m=+499.653099185" Jul 08 16:05:51.140124 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:05:51.140094 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59448bbd4f-8g9mx" Jul 08 16:06:33.232021 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.231989 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd"] Jul 08 16:06:33.235624 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.235605 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.238564 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.238541 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 16:06:33.240155 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.240133 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 16:06:33.240254 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.240201 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-28nwk\"" Jul 08 16:06:33.240311 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.240202 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 16:06:33.247095 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.247074 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd"] Jul 08 16:06:33.329158 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.329158 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.329386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329239 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.329386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.329386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8xzd\" (UniqueName: \"kubernetes.io/projected/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-kube-api-access-r8xzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.329386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.329361 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.429961 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.429934 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430133 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.429971 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430133 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430010 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430133 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430039 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430133 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8xzd\" (UniqueName: \"kubernetes.io/projected/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-kube-api-access-r8xzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430133 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430409 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430393 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430504 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430466 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.430563 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.430500 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.432256 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.432235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.432420 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.432404 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.439387 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.439364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8xzd\" (UniqueName: \"kubernetes.io/projected/922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6-kube-api-access-r8xzd\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd\" (UID: \"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.545749 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.545723 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:33.673934 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:33.673834 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd"] Jul 08 16:06:33.676161 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:06:33.676136 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922dacd5_1ed3_4cc3_b25a_4ad82fc9b7f6.slice/crio-1bdaad37aaca2d82d95d5501e117474ca1fd849ce883a4f884a93cbe64664247 WatchSource:0}: Error finding container 1bdaad37aaca2d82d95d5501e117474ca1fd849ce883a4f884a93cbe64664247: Status 404 returned error can't find the container with id 1bdaad37aaca2d82d95d5501e117474ca1fd849ce883a4f884a93cbe64664247 Jul 08 16:06:34.344818 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:34.344782 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" event={"ID":"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6","Type":"ContainerStarted","Data":"1bdaad37aaca2d82d95d5501e117474ca1fd849ce883a4f884a93cbe64664247"} Jul 08 16:06:35.350143 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:35.350108 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" event={"ID":"922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6","Type":"ContainerStarted","Data":"2085086253a521cd23a0348ee0254b87310bb23a9699cc84afb036c4196e74c9"} Jul 08 16:06:35.371415 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:35.371362 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" podStartSLOduration=1.2573504149999999 podStartE2EDuration="2.371346512s" totalImagesPullingTime="1.113996097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:35.369902237 +0000 UTC m=+554.872024042" watchObservedRunningTime="2026-07-08 16:06:35.371346512 +0000 UTC m=+554.873468318" Jul 08 16:06:42.722872 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.722842 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7"] Jul 08 16:06:42.725587 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.725562 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.728304 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.728284 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 16:06:42.741744 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.741719 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7"] Jul 08 16:06:42.806759 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806726 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.806759 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806761 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8jm7\" (UniqueName: \"kubernetes.io/projected/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-kube-api-access-b8jm7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.806927 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.806927 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.806927 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.807028 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.806948 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907500 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907643 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8jm7\" (UniqueName: \"kubernetes.io/projected/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-kube-api-access-b8jm7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907643 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907525 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907643 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907643 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907567 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907643 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907596 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.907951 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.907927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.908035 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.908014 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.908071 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.908044 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.909862 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.909841 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.910131 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.910112 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:42.916815 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:42.916771 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8jm7\" (UniqueName: \"kubernetes.io/projected/20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e-kube-api-access-b8jm7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-b8dt7\" (UID: \"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:43.042940 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.042917 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:43.172171 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.172148 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7"] Jul 08 16:06:43.174479 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:06:43.174453 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b6ffdc_9e5b_4e8a_ab82_70f15c7d4f1e.slice/crio-e3fea0bf5d2d5ed358c140a51323e6b461a557a95e6f9649b929ce9335c3da0d WatchSource:0}: Error finding container e3fea0bf5d2d5ed358c140a51323e6b461a557a95e6f9649b929ce9335c3da0d: Status 404 returned error can't find the container with id e3fea0bf5d2d5ed358c140a51323e6b461a557a95e6f9649b929ce9335c3da0d Jul 08 16:06:43.384003 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.383904 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" event={"ID":"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e","Type":"ContainerStarted","Data":"e3fea0bf5d2d5ed358c140a51323e6b461a557a95e6f9649b929ce9335c3da0d"} Jul 08 16:06:43.546241 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.546220 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:43.546353 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.546263 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:43.559274 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:43.559249 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:44.389219 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:44.389178 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" event={"ID":"20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e","Type":"ContainerStarted","Data":"b20fc14eef91b0ae2f8765b5f450122405acacf45bec48e582cac92567c5a2c4"} Jul 08 16:06:44.400364 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:44.400343 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd" Jul 08 16:06:44.408156 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:44.408120 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" podStartSLOduration=2.074456559 podStartE2EDuration="2.4081065s" totalImagesPullingTime="333.649941ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:44.407007394 +0000 UTC m=+563.909129199" watchObservedRunningTime="2026-07-08 16:06:44.4081065 +0000 UTC m=+563.910228305" Jul 08 16:06:53.043957 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:53.043924 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:53.044451 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:53.043980 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:53.056189 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:53.056168 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:06:53.437124 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:06:53.437052 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-b8dt7" Jul 08 16:07:18.604953 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.604921 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6"] Jul 08 16:07:18.607636 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.607613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.610310 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.610292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 16:07:18.617558 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.617533 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6"] Jul 08 16:07:18.708895 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.708860 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7n6v\" (UniqueName: \"kubernetes.io/projected/ad28595b-8678-443f-80d9-3b55065fd9d0-kube-api-access-m7n6v\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.709046 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.708906 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.709046 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.708997 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad28595b-8678-443f-80d9-3b55065fd9d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.709046 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.709027 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.709046 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.709042 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.709178 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.709060 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.809945 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.809909 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad28595b-8678-443f-80d9-3b55065fd9d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810103 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.809955 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810103 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.809974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810103 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.809997 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810103 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.810031 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7n6v\" (UniqueName: \"kubernetes.io/projected/ad28595b-8678-443f-80d9-3b55065fd9d0-kube-api-access-m7n6v\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810103 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.810071 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810385 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.810364 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810479 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.810457 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.810548 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.810530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.812386 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.812363 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad28595b-8678-443f-80d9-3b55065fd9d0-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.812523 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.812509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad28595b-8678-443f-80d9-3b55065fd9d0-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.818570 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.818546 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7n6v\" (UniqueName: \"kubernetes.io/projected/ad28595b-8678-443f-80d9-3b55065fd9d0-kube-api-access-m7n6v\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6\" (UID: \"ad28595b-8678-443f-80d9-3b55065fd9d0\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:18.917846 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:18.917759 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:19.041582 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:19.041556 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6"] Jul 08 16:07:19.043666 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:07:19.043639 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad28595b_8678_443f_80d9_3b55065fd9d0.slice/crio-c001402f77c4eb361debe37f64fc33a2e8fdb67ed3d0a6c1c5f15f921835dcea WatchSource:0}: Error finding container c001402f77c4eb361debe37f64fc33a2e8fdb67ed3d0a6c1c5f15f921835dcea: Status 404 returned error can't find the container with id c001402f77c4eb361debe37f64fc33a2e8fdb67ed3d0a6c1c5f15f921835dcea Jul 08 16:07:19.535162 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:19.535126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" event={"ID":"ad28595b-8678-443f-80d9-3b55065fd9d0","Type":"ContainerStarted","Data":"061e5012d9884436266512bf4a1f5d68c30a0e96e8af6b26b70b50b41cc58d21"} Jul 08 16:07:19.535162 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:19.535167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" event={"ID":"ad28595b-8678-443f-80d9-3b55065fd9d0","Type":"ContainerStarted","Data":"c001402f77c4eb361debe37f64fc33a2e8fdb67ed3d0a6c1c5f15f921835dcea"} Jul 08 16:07:19.554173 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:19.554130 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" podStartSLOduration=1.217195397 podStartE2EDuration="1.554115643s" totalImagesPullingTime="336.920246ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:07:19.552692518 +0000 UTC m=+599.054814324" watchObservedRunningTime="2026-07-08 16:07:19.554115643 +0000 UTC m=+599.056237447" Jul 08 16:07:28.917930 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:28.917895 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:28.918320 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:28.917952 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:28.930062 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:28.930034 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:07:29.588741 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:07:29.588714 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6" Jul 08 16:08:34.691366 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.691335 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d4d559c9b-zvjbk"] Jul 08 16:08:34.693961 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.693944 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.702672 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.702648 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d4d559c9b-zvjbk"] Jul 08 16:08:34.855872 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.855843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5mqp\" (UniqueName: \"kubernetes.io/projected/6e4568fd-4613-4c94-b815-23064339dc7a-kube-api-access-g5mqp\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.856048 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.855894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e4568fd-4613-4c94-b815-23064339dc7a-tls-cert\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.956351 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.956270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e4568fd-4613-4c94-b815-23064339dc7a-tls-cert\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.956351 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.956337 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5mqp\" (UniqueName: \"kubernetes.io/projected/6e4568fd-4613-4c94-b815-23064339dc7a-kube-api-access-g5mqp\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.958758 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.958734 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6e4568fd-4613-4c94-b815-23064339dc7a-tls-cert\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:34.964765 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:34.964740 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5mqp\" (UniqueName: \"kubernetes.io/projected/6e4568fd-4613-4c94-b815-23064339dc7a-kube-api-access-g5mqp\") pod \"authorino-d4d559c9b-zvjbk\" (UID: \"6e4568fd-4613-4c94-b815-23064339dc7a\") " pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:35.003141 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.003122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d4d559c9b-zvjbk" Jul 08 16:08:35.143301 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.143279 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d4d559c9b-zvjbk"] Jul 08 16:08:35.145182 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:08:35.145140 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e4568fd_4613_4c94_b815_23064339dc7a.slice/crio-5bcf961468ec7a2d5c90544376c5b6ceaefd37a5ff67c71d405d8f394636ca0c WatchSource:0}: Error finding container 5bcf961468ec7a2d5c90544376c5b6ceaefd37a5ff67c71d405d8f394636ca0c: Status 404 returned error can't find the container with id 5bcf961468ec7a2d5c90544376c5b6ceaefd37a5ff67c71d405d8f394636ca0c Jul 08 16:08:35.146510 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.146494 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:08:35.860417 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.860384 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4d559c9b-zvjbk" event={"ID":"6e4568fd-4613-4c94-b815-23064339dc7a","Type":"ContainerStarted","Data":"0e03bd10dcd8a6947ae531364366bbfd632b4147045f4f49440cb3b53fa6368d"} Jul 08 16:08:35.860849 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.860422 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d4d559c9b-zvjbk" event={"ID":"6e4568fd-4613-4c94-b815-23064339dc7a","Type":"ContainerStarted","Data":"5bcf961468ec7a2d5c90544376c5b6ceaefd37a5ff67c71d405d8f394636ca0c"} Jul 08 16:08:35.882463 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.882382 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d4d559c9b-zvjbk" podStartSLOduration=1.370516343 podStartE2EDuration="1.882362772s" totalImagesPullingTime="511.846429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:35.881592584 +0000 UTC m=+675.383714414" watchObservedRunningTime="2026-07-08 16:08:35.882362772 +0000 UTC m=+675.384484579" Jul 08 16:08:35.922313 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.922226 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:08:35.922506 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:35.922412 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85bff497df-rttr9" podUID="4bf723aa-717f-438d-a391-0a6ed8fab171" containerName="authorino" containerID="cri-o://9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8" gracePeriod=30 Jul 08 16:08:36.187593 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.187541 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:08:36.266798 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.266768 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert\") pod \"4bf723aa-717f-438d-a391-0a6ed8fab171\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " Jul 08 16:08:36.266986 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.266842 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shbh5\" (UniqueName: \"kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5\") pod \"4bf723aa-717f-438d-a391-0a6ed8fab171\" (UID: \"4bf723aa-717f-438d-a391-0a6ed8fab171\") " Jul 08 16:08:36.269465 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.269408 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5" (OuterVolumeSpecName: "kube-api-access-shbh5") pod "4bf723aa-717f-438d-a391-0a6ed8fab171" (UID: "4bf723aa-717f-438d-a391-0a6ed8fab171"). InnerVolumeSpecName "kube-api-access-shbh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:08:36.283967 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.283929 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4bf723aa-717f-438d-a391-0a6ed8fab171" (UID: "4bf723aa-717f-438d-a391-0a6ed8fab171"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:08:36.367969 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.367938 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bf723aa-717f-438d-a391-0a6ed8fab171-tls-cert\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:08:36.367969 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.367965 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shbh5\" (UniqueName: \"kubernetes.io/projected/4bf723aa-717f-438d-a391-0a6ed8fab171-kube-api-access-shbh5\") on node \"ip-10-0-133-83.ec2.internal\" DevicePath \"\"" Jul 08 16:08:36.867900 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.867857 2578 generic.go:356] "Generic (PLEG): container finished" podID="4bf723aa-717f-438d-a391-0a6ed8fab171" containerID="9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8" exitCode=0 Jul 08 16:08:36.868547 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.868518 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bff497df-rttr9" Jul 08 16:08:36.871277 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.871216 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bff497df-rttr9" event={"ID":"4bf723aa-717f-438d-a391-0a6ed8fab171","Type":"ContainerDied","Data":"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8"} Jul 08 16:08:36.871277 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.871274 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bff497df-rttr9" event={"ID":"4bf723aa-717f-438d-a391-0a6ed8fab171","Type":"ContainerDied","Data":"4c7bc6266ce8128129462b47723d7860185e4335d9348a4c5106dfde17b14980"} Jul 08 16:08:36.871499 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.871299 2578 scope.go:117] "RemoveContainer" containerID="9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8" Jul 08 16:08:36.881042 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.881023 2578 scope.go:117] "RemoveContainer" containerID="9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8" Jul 08 16:08:36.881399 ip-10-0-133-83 kubenswrapper[2578]: E0708 16:08:36.881376 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8\": container with ID starting with 9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8 not found: ID does not exist" containerID="9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8" Jul 08 16:08:36.881500 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.881410 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8"} err="failed to get container status \"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8\": rpc error: code = NotFound desc = could not find container \"9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8\": container with ID starting with 9a293e0d19f79f32b19d83e1af8df691b37467ad20e39ca7c423c0ed8523b6b8 not found: ID does not exist" Jul 08 16:08:36.921542 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.921516 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:08:36.923779 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:36.923759 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85bff497df-rttr9"] Jul 08 16:08:37.163121 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:08:37.163055 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bf723aa-717f-438d-a391-0a6ed8fab171" path="/var/lib/kubelet/pods/4bf723aa-717f-438d-a391-0a6ed8fab171/volumes" Jul 08 16:09:13.946614 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:13.946539 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d4d559c9b-zvjbk_6e4568fd-4613-4c94-b815-23064339dc7a/authorino/0.log" Jul 08 16:09:18.678115 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:18.678075 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59448bbd4f-8g9mx_33bb27a9-71fa-46c9-b11f-1779d25ba7b3/manager/0.log" Jul 08 16:09:19.293372 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:19.293343 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq_e54c0239-1629-4eb6-93e0-dca392fd1d08/copy-manifests/0.log" Jul 08 16:09:19.309851 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:19.309821 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq_e54c0239-1629-4eb6-93e0-dca392fd1d08/manager/0.log" Jul 08 16:09:20.581997 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:20.581964 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d4d559c9b-zvjbk_6e4568fd-4613-4c94-b815-23064339dc7a/authorino/0.log" Jul 08 16:09:20.801053 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:20.801028 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5kpk2_01fd30e5-62a6-441c-a9d1-a7d1bc8178e9/manager/0.log" Jul 08 16:09:20.904864 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:20.904798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b8dtx_2dbf45a5-00b1-41c3-9770-13f6eac97371/kuadrant-console-plugin/0.log" Jul 08 16:09:22.044977 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:22.044944 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf8d5857-tmdjc_2952fac7-3d3a-4fe9-af92-9d573bcc80af/kube-auth-proxy/0.log" Jul 08 16:09:22.612847 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:22.612816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-r82nd_922dacd5-1ed3-4cc3-b25a-4ad82fc9b7f6/main/0.log" Jul 08 16:09:22.727829 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:22.727798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-b8dt7_20b6ffdc-9e5b-4e8a-ab82-70f15c7d4f1e/main/0.log" Jul 08 16:09:23.194827 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:23.194791 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-s6gf6_ad28595b-8678-443f-80d9-3b55065fd9d0/main/0.log" Jul 08 16:09:30.016999 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:30.016971 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dhfz5_dcc2c9d5-9e11-4e99-9fa5-3edb67c4e19a/global-pull-secret-syncer/0.log" Jul 08 16:09:30.108019 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:30.107995 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-stvjw_a8d10b2b-480a-443c-9863-8c710574e93a/konnectivity-agent/0.log" Jul 08 16:09:30.159478 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:30.159441 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-83.ec2.internal_608cb704942ea47d5ae3121b19e8816a/haproxy/0.log" Jul 08 16:09:35.350385 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:35.350353 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d4d559c9b-zvjbk_6e4568fd-4613-4c94-b815-23064339dc7a/authorino/0.log" Jul 08 16:09:35.414035 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:35.414005 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-5kpk2_01fd30e5-62a6-441c-a9d1-a7d1bc8178e9/manager/0.log" Jul 08 16:09:35.445570 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:35.445546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-b8dtx_2dbf45a5-00b1-41c3-9770-13f6eac97371/kuadrant-console-plugin/0.log" Jul 08 16:09:37.709690 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:37.709666 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mk8pk_a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c/kube-state-metrics/0.log" Jul 08 16:09:37.738452 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:37.738403 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mk8pk_a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c/kube-rbac-proxy-main/0.log" Jul 08 16:09:37.773553 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:37.773525 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mk8pk_a9271cf0-f7f6-44f9-af9d-e0c9336d5b8c/kube-rbac-proxy-self/0.log" Jul 08 16:09:37.997374 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:37.997296 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kc6pp_7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2/node-exporter/0.log" Jul 08 16:09:38.031858 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.031827 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kc6pp_7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2/kube-rbac-proxy/0.log" Jul 08 16:09:38.058937 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.058916 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kc6pp_7bb9d9d2-fc01-4f20-934a-a7f7d5acd4c2/init-textfile/0.log" Jul 08 16:09:38.277774 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.277745 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/prometheus/0.log" Jul 08 16:09:38.302207 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.302189 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/config-reloader/0.log" Jul 08 16:09:38.346496 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.346474 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/thanos-sidecar/0.log" Jul 08 16:09:38.381262 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.381243 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/kube-rbac-proxy-web/0.log" Jul 08 16:09:38.407446 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.407400 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/kube-rbac-proxy/0.log" Jul 08 16:09:38.433286 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.433267 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/kube-rbac-proxy-thanos/0.log" Jul 08 16:09:38.457234 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.457219 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a0ce0f50-fc2a-409a-b68e-01051fd595a1/init-config-reloader/0.log" Jul 08 16:09:38.488898 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.488878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-26hw5_b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c/prometheus-operator/0.log" Jul 08 16:09:38.509343 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:38.509327 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-26hw5_b7c9ad46-f3f9-4a9e-9204-2c893ac4cc6c/kube-rbac-proxy/0.log" Jul 08 16:09:39.413567 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.413527 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj"] Jul 08 16:09:39.413920 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.413852 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bf723aa-717f-438d-a391-0a6ed8fab171" containerName="authorino" Jul 08 16:09:39.413920 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.413868 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bf723aa-717f-438d-a391-0a6ed8fab171" containerName="authorino" Jul 08 16:09:39.413993 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.413927 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bf723aa-717f-438d-a391-0a6ed8fab171" containerName="authorino" Jul 08 16:09:39.417655 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.417636 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.420486 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.420465 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqgt8\"/\"kube-root-ca.crt\"" Jul 08 16:09:39.420486 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.420469 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zqgt8\"/\"default-dockercfg-j9fw5\"" Jul 08 16:09:39.420669 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.420497 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zqgt8\"/\"openshift-service-ca.crt\"" Jul 08 16:09:39.429469 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.429450 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj"] Jul 08 16:09:39.464832 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.464810 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.464952 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.464839 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.464952 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.464869 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.464952 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.464907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.464952 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.464924 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvsm\" (UniqueName: \"kubernetes.io/projected/2f79780f-7bb2-4627-9548-300af8ca87f0-kube-api-access-wpvsm\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566092 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566213 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566099 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566213 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566136 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566213 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566177 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-proc\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566213 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566184 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566213 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvsm\" (UniqueName: \"kubernetes.io/projected/2f79780f-7bb2-4627-9548-300af8ca87f0-kube-api-access-wpvsm\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566490 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-sys\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566490 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566270 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-podres\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.566490 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.566339 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2f79780f-7bb2-4627-9548-300af8ca87f0-lib-modules\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.574392 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.574370 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvsm\" (UniqueName: \"kubernetes.io/projected/2f79780f-7bb2-4627-9548-300af8ca87f0-kube-api-access-wpvsm\") pod \"perf-node-gather-daemonset-bnxmj\" (UID: \"2f79780f-7bb2-4627-9548-300af8ca87f0\") " pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.727372 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.727287 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:39.851255 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:39.851224 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj"] Jul 08 16:09:39.853990 ip-10-0-133-83 kubenswrapper[2578]: W0708 16:09:39.853966 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2f79780f_7bb2_4627_9548_300af8ca87f0.slice/crio-8daf4ed4f394fa3dfbfd4217ff6b41dd28a3be5b7981fec393f8ea855a076b2f WatchSource:0}: Error finding container 8daf4ed4f394fa3dfbfd4217ff6b41dd28a3be5b7981fec393f8ea855a076b2f: Status 404 returned error can't find the container with id 8daf4ed4f394fa3dfbfd4217ff6b41dd28a3be5b7981fec393f8ea855a076b2f Jul 08 16:09:40.141483 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:40.141421 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" event={"ID":"2f79780f-7bb2-4627-9548-300af8ca87f0","Type":"ContainerStarted","Data":"e3b4338e9d8b027a460c8fe586ceaf9aa86308629072aa2996713545787dd298"} Jul 08 16:09:40.141666 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:40.141500 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" event={"ID":"2f79780f-7bb2-4627-9548-300af8ca87f0","Type":"ContainerStarted","Data":"8daf4ed4f394fa3dfbfd4217ff6b41dd28a3be5b7981fec393f8ea855a076b2f"} Jul 08 16:09:40.141666 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:40.141555 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:40.158908 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:40.158863 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" podStartSLOduration=1.158848582 podStartE2EDuration="1.158848582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:09:40.157860709 +0000 UTC m=+739.659982515" watchObservedRunningTime="2026-07-08 16:09:40.158848582 +0000 UTC m=+739.660970386" Jul 08 16:09:42.938144 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:42.938118 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lwqf_1dc04790-9138-41e4-950e-c35bf8db7d6c/dns/0.log" Jul 08 16:09:42.960568 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:42.960546 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6lwqf_1dc04790-9138-41e4-950e-c35bf8db7d6c/kube-rbac-proxy/0.log" Jul 08 16:09:43.089372 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:43.089340 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sdzht_c4df404f-22bc-4c43-b6cd-3facfa6fb969/dns-node-resolver/0.log" Jul 08 16:09:43.704637 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:43.704602 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rk4t8_ee42f286-3196-4bcb-8822-3aaa9b2b4d73/node-ca/0.log" Jul 08 16:09:44.848054 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:44.848023 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf8d5857-tmdjc_2952fac7-3d3a-4fe9-af92-9d573bcc80af/kube-auth-proxy/0.log" Jul 08 16:09:45.579337 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:45.579308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xtrfd_da20bb99-c830-40a3-a5e2-875ebbab577a/serve-healthcheck-canary/0.log" Jul 08 16:09:46.106186 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:46.106145 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqxhd_df6d4aa7-c586-4605-b654-3dc27e30796f/kube-rbac-proxy/0.log" Jul 08 16:09:46.131172 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:46.131153 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqxhd_df6d4aa7-c586-4605-b654-3dc27e30796f/exporter/0.log" Jul 08 16:09:46.155058 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:46.155039 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqxhd_df6d4aa7-c586-4605-b654-3dc27e30796f/extractor/0.log" Jul 08 16:09:46.156090 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:46.156073 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zqgt8/perf-node-gather-daemonset-bnxmj" Jul 08 16:09:48.868164 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:48.868137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59448bbd4f-8g9mx_33bb27a9-71fa-46c9-b11f-1779d25ba7b3/manager/0.log" Jul 08 16:09:49.124944 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:49.124918 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq_e54c0239-1629-4eb6-93e0-dca392fd1d08/manager/0.log" Jul 08 16:09:49.149177 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:49.149149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f4cdbd6c9-vd5sq_e54c0239-1629-4eb6-93e0-dca392fd1d08/copy-manifests/0.log" Jul 08 16:09:50.361698 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:50.361668 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6d876f9cf6-trqkj_25b309b8-e3ad-4913-a2d6-682501149cff/manager/0.log" Jul 08 16:09:50.420453 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:50.420405 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf8d5857-tmdjc_2952fac7-3d3a-4fe9-af92-9d573bcc80af/kube-auth-proxy/0.log" Jul 08 16:09:51.589895 ip-10-0-133-83 kubenswrapper[2578]: I0708 16:09:51.589861 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-ccf8d5857-tmdjc_2952fac7-3d3a-4fe9-af92-9d573bcc80af/kube-auth-proxy/0.log"