Jul 30 20:55:21.988298 ip-10-0-133-49 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 30 20:55:21.988312 ip-10-0-133-49 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 30 20:55:21.988321 ip-10-0-133-49 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 30 20:55:21.988619 ip-10-0-133-49 systemd[1]: Failed to start Kubernetes Kubelet. Jul 30 20:55:31.602563 ip-10-0-133-49 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 30 20:55:31.602582 ip-10-0-133-49 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot a6a20f2077264df08ea57ccf9d4c9400 -- Jul 30 20:57:20.328596 ip-10-0-133-49 systemd[1]: Starting Kubernetes Kubelet... Jul 30 20:57:22.186733 ip-10-0-133-49 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 20:57:22.186733 ip-10-0-133-49 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 30 20:57:22.186733 ip-10-0-133-49 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 20:57:22.186733 ip-10-0-133-49 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 30 20:57:22.186733 ip-10-0-133-49 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 30 20:57:22.187536 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.187447 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 30 20:57:22.191911 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191895 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.191911 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191911 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191915 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191918 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191921 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191924 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191927 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191929 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191932 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191935 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191937 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191940 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191943 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191945 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191949 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191952 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191954 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191957 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191960 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191963 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191965 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.191975 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191968 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191970 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191973 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191976 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191982 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191985 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191988 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191991 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191993 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191996 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.191999 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192001 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192004 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192006 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192009 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192012 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192014 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192017 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192020 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.192466 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192022 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192025 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192027 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192030 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192032 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192035 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192037 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192039 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192042 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192044 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192047 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192049 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192052 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192054 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192057 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192060 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192063 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192066 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192068 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192071 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.192933 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192074 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192076 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192079 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192081 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192084 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192086 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192090 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192092 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192095 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192097 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192100 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192104 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192107 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192122 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192125 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192129 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192131 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192134 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192137 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.193431 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192141 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192144 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192147 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192150 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192153 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192155 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192160 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192164 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192167 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192170 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192174 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192176 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192180 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192185 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192188 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192190 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192193 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192196 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192198 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.193937 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192201 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192912 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192918 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192920 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192923 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192926 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192929 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192932 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192935 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192937 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192941 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192944 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192947 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192950 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192953 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192955 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192958 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192960 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192963 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192966 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.194414 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192968 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192971 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192974 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192976 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192979 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192982 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192984 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192987 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192989 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192992 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192994 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.192997 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193000 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193002 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193004 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193007 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193010 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193012 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193014 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.194905 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193017 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193019 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193022 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193024 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193027 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193029 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193035 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193039 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193042 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193045 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193048 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193050 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193054 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193056 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193059 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193062 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193064 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193067 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193069 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.195382 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193072 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193074 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193077 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193081 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193084 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193087 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193090 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193094 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193096 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193099 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193101 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193104 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193106 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193109 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193125 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193128 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193131 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193133 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193137 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193140 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.195844 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193143 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193146 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193149 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193151 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193154 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193156 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193159 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193161 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193164 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193166 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193169 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193172 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193174 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193177 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193179 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193181 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193184 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193187 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193191 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193194 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.196369 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193196 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193199 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193623 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193628 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193632 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193635 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193638 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193642 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193645 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193648 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193652 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193655 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193658 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193660 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193663 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193666 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193669 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193672 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193674 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193677 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.196871 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193679 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193682 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193685 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193688 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193690 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193693 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193695 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193698 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193700 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193702 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193705 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193707 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193710 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193712 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193715 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193717 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193720 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193723 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193725 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193728 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.197377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193730 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193733 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193736 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193739 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193742 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193745 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193748 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193751 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193754 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193756 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193758 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193761 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193763 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193766 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193769 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193773 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193776 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193779 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193782 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.197891 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193784 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193788 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193791 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193794 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193797 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193800 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193803 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193805 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193808 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193810 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193813 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193815 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193818 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193820 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193823 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193826 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193829 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193832 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193835 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.198377 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193838 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193840 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193843 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193845 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193848 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193850 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193853 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193855 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193858 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193861 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193864 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193866 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193868 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193871 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193873 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193876 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193878 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193881 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193883 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193886 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.198833 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193890 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193893 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.193896 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193966 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193973 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193978 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193982 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193987 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193990 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193994 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.193998 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194003 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194006 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194009 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194013 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194016 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194019 2577 flags.go:64] FLAG: --cgroup-root="" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194022 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194025 2577 flags.go:64] FLAG: --client-ca-file="" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194028 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194031 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194035 2577 flags.go:64] FLAG: --cluster-domain="" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194038 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194041 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 30 20:57:22.199355 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194044 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194048 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194051 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194054 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194058 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194061 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194064 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194067 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194070 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194073 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194076 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194080 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194083 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194086 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194089 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194094 2577 flags.go:64] FLAG: --enable-server="true" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194097 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194103 2577 flags.go:64] FLAG: --event-burst="100" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194106 2577 flags.go:64] FLAG: --event-qps="50" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194122 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194126 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194129 2577 flags.go:64] FLAG: --eviction-hard="" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194133 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194136 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194139 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 30 20:57:22.199929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194142 2577 flags.go:64] FLAG: --eviction-soft="" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194145 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194148 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194151 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194153 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194156 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194160 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194162 2577 flags.go:64] FLAG: --feature-gates="" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194166 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194169 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194172 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194175 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194178 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194181 2577 flags.go:64] FLAG: --help="false" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194184 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194187 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194190 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194193 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194196 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194199 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194202 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194205 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194209 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 30 20:57:22.200577 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194212 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194216 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194219 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194222 2577 flags.go:64] FLAG: --kube-reserved="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194225 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194229 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194232 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194235 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194238 2577 flags.go:64] FLAG: --lock-file="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194241 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194243 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194246 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194251 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194254 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194257 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194260 2577 flags.go:64] FLAG: --logging-format="text" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194263 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194266 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194269 2577 flags.go:64] FLAG: --manifest-url="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194272 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194276 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194279 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194282 2577 flags.go:64] FLAG: --max-pods="110" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194285 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194288 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 30 20:57:22.201465 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194291 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194294 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194297 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194300 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194303 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194310 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194314 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194317 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194322 2577 flags.go:64] FLAG: --pod-cidr="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194325 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194330 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194333 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194336 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194339 2577 flags.go:64] FLAG: --port="10250" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194342 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194345 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-029eb8c15fa95599c" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194349 2577 flags.go:64] FLAG: --qos-reserved="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194352 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194355 2577 flags.go:64] FLAG: --register-node="true" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194358 2577 flags.go:64] FLAG: --register-with-taints="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194361 2577 flags.go:64] FLAG: --registry-burst="10" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194364 2577 flags.go:64] FLAG: --registry-qps="5" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194367 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194370 2577 flags.go:64] FLAG: --reserved-memory="" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194374 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 30 20:57:22.202553 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194377 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194379 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194382 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194385 2577 flags.go:64] FLAG: --runonce="false" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194388 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194391 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194394 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194397 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194400 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194403 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194406 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194408 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194411 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194415 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194418 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194421 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194426 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194429 2577 flags.go:64] FLAG: --system-cgroups="" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194432 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194437 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194441 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194444 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194449 2577 flags.go:64] FLAG: --tls-min-version="" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194452 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194455 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 30 20:57:22.203645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194457 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194460 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194463 2577 flags.go:64] FLAG: --v="2" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194467 2577 flags.go:64] FLAG: --version="false" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194470 2577 flags.go:64] FLAG: --vmodule="" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194474 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.194477 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194606 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194610 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194613 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194616 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194619 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194622 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194625 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194628 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194631 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194634 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194636 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194639 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194641 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194645 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.204701 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194648 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194650 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194654 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194657 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194661 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194663 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194666 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194668 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194673 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194676 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194680 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194683 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194685 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194688 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194691 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194693 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194696 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194698 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194701 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.205444 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194703 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194706 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194708 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194711 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194713 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194716 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194719 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194721 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194724 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194726 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194729 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194732 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194735 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194737 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194740 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194744 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194747 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194749 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194752 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194755 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.206250 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194757 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194760 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194763 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194766 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194769 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194772 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194774 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194777 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194779 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194782 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194784 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194787 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194791 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194794 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194797 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194800 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194803 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194805 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194808 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194811 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.206828 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194813 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194816 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194818 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194821 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194825 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194828 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194830 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194834 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194837 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194839 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194842 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194844 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194847 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194850 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194852 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194855 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194858 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194860 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194863 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194865 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.207461 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194868 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194871 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194875 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194878 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194880 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.194883 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.195893 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.203019 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.203038 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.203057 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.203066 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203169 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203179 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203185 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.207973 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203190 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203194 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203198 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203203 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203207 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203212 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203216 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203220 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203225 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203229 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203234 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203238 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203243 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203247 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203251 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203255 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203260 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203264 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203268 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.208352 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203272 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203277 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203281 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203285 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203290 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203294 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203299 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203305 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203309 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203314 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203318 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203322 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203327 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203331 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203335 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203340 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203344 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203348 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203352 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203356 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.208886 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203363 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203368 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203373 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203377 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203382 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203386 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203390 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203394 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203398 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203402 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203407 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203411 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203415 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203420 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203424 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203429 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203433 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203437 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203442 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203446 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.209572 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203455 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203460 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203464 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203468 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203472 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203477 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203481 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203485 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203489 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203494 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203498 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203502 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203507 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203511 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203517 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203523 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203527 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203531 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203536 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.210064 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203540 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203545 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203549 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203553 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203558 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203562 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203566 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203570 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203575 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203579 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203583 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203587 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203592 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203596 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203601 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203604 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203609 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.210610 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203615 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.203624 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203805 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203815 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203822 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203829 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203834 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203839 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203844 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203849 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203853 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203857 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203861 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203865 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 30 20:57:22.211212 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203870 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203874 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203878 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203883 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203887 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203891 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203895 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203899 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203904 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203908 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203913 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203917 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203921 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203925 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203930 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203934 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203939 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203943 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203947 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203952 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 30 20:57:22.211558 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203956 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203961 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203965 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203969 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203975 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203979 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203988 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203992 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.203998 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204004 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204008 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204012 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204017 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204021 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204026 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204030 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204035 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204040 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 30 20:57:22.212040 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204045 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204050 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204054 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204059 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204063 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204067 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204071 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204075 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204080 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204084 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204089 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204093 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204098 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204102 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204106 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204125 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204131 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204135 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204139 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204143 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 30 20:57:22.212509 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204147 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204152 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204156 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204160 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204164 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204169 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204172 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204177 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204181 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204185 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204189 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204194 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204198 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204202 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204207 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204211 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204215 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204219 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204223 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204227 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 30 20:57:22.213037 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204231 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204236 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204240 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204244 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204248 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204253 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204257 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:22.204261 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.204269 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.204429 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.207217 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.208443 2577 server.go:1019] "Starting client certificate rotation" Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.208543 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 20:57:22.213566 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.210549 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 30 20:57:22.213983 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.213967 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 20:57:22.218601 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.218582 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 30 20:57:22.231040 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.231022 2577 log.go:25] "Validated CRI v1 runtime API" Jul 30 20:57:22.233007 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.232992 2577 log.go:25] "Validated CRI v1 image API" Jul 30 20:57:22.234284 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.234262 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 30 20:57:22.239161 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.239092 2577 fs.go:135] Filesystem UUIDs: map[135f5cd3-f419-4e90-8727-1832fe8f93bc:/dev/nvme0n1p4 5dba4d2c-eee7-4152-8599-81ef1a4ccf5c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 30 20:57:22.239161 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.239131 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 30 20:57:22.240740 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.240725 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 20:57:22.244122 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.244010 2577 manager.go:216] Machine: {Timestamp:2026-07-30 20:57:22.242736852 +0000 UTC m=+0.339962657 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100496 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2805e0fbd93a0cbefcbf023d583aeb SystemUUID:ec2805e0-fbd9-3a0c-befc-bf023d583aeb BootID:a6a20f20-7726-4df0-8ea5-7ccf9d4c9400 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:79:a2:db:7c:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:79:a2:db:7c:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:1c:ae:70:22:30 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 30 20:57:22.244122 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.244108 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 30 20:57:22.244231 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.244199 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 30 20:57:22.246745 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.246715 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 30 20:57:22.246881 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.246748 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 30 20:57:22.247733 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.247723 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 30 20:57:22.247771 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.247734 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 30 20:57:22.247771 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.247742 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 20:57:22.247771 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.247755 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 30 20:57:22.248843 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.248832 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 30 20:57:22.253175 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253162 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 30 20:57:22.253284 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253274 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 30 20:57:22.253315 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253302 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 30 20:57:22.253315 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253312 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 30 20:57:22.253369 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253323 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 30 20:57:22.253369 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253332 2577 kubelet.go:398] "Adding apiserver pod source" Jul 30 20:57:22.253369 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253340 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 30 20:57:22.253687 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253676 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 20:57:22.253734 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.253694 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 30 20:57:22.256312 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.256295 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 30 20:57:22.263407 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.263389 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 30 20:57:22.263490 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.263423 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 30 20:57:22.265517 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.265485 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 30 20:57:22.265616 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.265575 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 30 20:57:22.265811 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.265795 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hlqc" Jul 30 20:57:22.265984 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.265971 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 30 20:57:22.266015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.265990 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 30 20:57:22.266015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.265998 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 30 20:57:22.266015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266007 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266017 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266023 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266031 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266037 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266044 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266049 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266057 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266063 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266087 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 30 20:57:22.266139 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.266094 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 30 20:57:22.269291 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.269276 2577 server.go:1268] "Started kubelet" Jul 30 20:57:22.269387 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.269360 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 30 20:57:22.269435 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.269365 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 30 20:57:22.269490 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.269436 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 30 20:57:22.270301 ip-10-0-133-49 systemd[1]: Started Kubernetes Kubelet. Jul 30 20:57:22.270520 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.270493 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 30 20:57:22.270839 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.270787 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 30 20:57:22.275432 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.275413 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6hlqc" Jul 30 20:57:22.276324 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.276305 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 30 20:57:22.276431 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.276391 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.276535 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.276310 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 30 20:57:22.276725 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.276708 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 30 20:57:22.276933 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.276911 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 30 20:57:22.277009 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.276962 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 30 20:57:22.277060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277023 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 30 20:57:22.277060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277040 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 30 20:57:22.277253 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277236 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 30 20:57:22.277353 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277259 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 30 20:57:22.277353 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277258 2577 factory.go:55] Registering systemd factory Jul 30 20:57:22.277353 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277282 2577 factory.go:223] Registration of the systemd container factory successfully Jul 30 20:57:22.277548 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277529 2577 factory.go:153] Registering CRI-O factory Jul 30 20:57:22.277548 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277549 2577 factory.go:223] Registration of the crio container factory successfully Jul 30 20:57:22.277659 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277595 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 30 20:57:22.277659 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277622 2577 factory.go:103] Registering Raw factory Jul 30 20:57:22.277659 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.277634 2577 manager.go:1196] Started watching for new ooms in manager Jul 30 20:57:22.278014 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.278002 2577 manager.go:349] Starting recovery of all containers Jul 30 20:57:22.278542 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.276889 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-49.ec2.internal.18c72cce6670d795 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-49.ec2.internal,UID:ip-10-0-133-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-49.ec2.internal,},FirstTimestamp:2026-07-30 20:57:22.269247381 +0000 UTC m=+0.366473165,LastTimestamp:2026-07-30 20:57:22.269247381 +0000 UTC m=+0.366473165,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-49.ec2.internal,}" Jul 30 20:57:22.281923 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.281889 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 30 20:57:22.282018 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.281988 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 30 20:57:22.289090 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.288932 2577 manager.go:354] Recovery completed Jul 30 20:57:22.294890 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.294876 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.296666 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.296650 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.296713 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.296683 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.296713 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.296695 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.297308 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.297199 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 30 20:57:22.297308 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.297210 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 30 20:57:22.297308 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.297226 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 30 20:57:22.297436 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.297202 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.298089 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.298071 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.298176 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.298108 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.298176 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.298138 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.299279 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.299268 2577 policy_none.go:49] "None policy: Start" Jul 30 20:57:22.299313 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.299283 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 30 20:57:22.299313 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.299293 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 30 20:57:22.301276 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.301264 2577 policy_none.go:47] "Start" Jul 30 20:57:22.340641 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.340621 2577 manager.go:337] "Starting Device Plugin manager" Jul 30 20:57:22.340716 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.340650 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 30 20:57:22.340716 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.340661 2577 server.go:87] "Starting device plugin registration server" Jul 30 20:57:22.340901 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.340887 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 30 20:57:22.341013 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.340899 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 30 20:57:22.341013 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.341007 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 30 20:57:22.341132 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.341077 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 30 20:57:22.341132 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.341086 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 30 20:57:22.341676 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.341652 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 30 20:57:22.341737 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.341713 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.401798 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.401767 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 30 20:57:22.403829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.402972 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 30 20:57:22.403829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.403005 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 30 20:57:22.403829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.403028 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 30 20:57:22.403829 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.403064 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 30 20:57:22.405280 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.405261 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 20:57:22.442018 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.441995 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.442777 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.442764 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.442835 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.442791 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.442835 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.442802 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.442835 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.442823 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.450981 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.450969 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.451024 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.450989 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-49.ec2.internal\": node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.464956 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.464939 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.503474 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.503427 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal"] Jul 30 20:57:22.503540 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.503480 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.504859 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.504844 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.504929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.504871 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.504929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.504881 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.507208 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507196 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.507350 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507337 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.507393 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507364 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.507908 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507891 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.507965 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507924 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.507965 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507935 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.508025 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.507891 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.508025 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.508001 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.508025 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.508013 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.510161 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.510149 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.510206 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.510176 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 30 20:57:22.510893 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.510880 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientMemory" Jul 30 20:57:22.510941 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.510906 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasNoDiskPressure" Jul 30 20:57:22.510941 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.510918 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeHasSufficientPID" Jul 30 20:57:22.533866 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.533844 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-49.ec2.internal\" not found" node="ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.538266 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.538252 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-49.ec2.internal\" not found" node="ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.565292 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.565265 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.578354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.578335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1668fe2fbcb786c1ffb20c9700e9cb32-config\") pod \"kube-apiserver-proxy-ip-10-0-133-49.ec2.internal\" (UID: \"1668fe2fbcb786c1ffb20c9700e9cb32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.578411 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.578366 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.578411 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.578391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.666359 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.666318 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.678612 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.678666 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678621 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.678666 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1668fe2fbcb786c1ffb20c9700e9cb32-config\") pod \"kube-apiserver-proxy-ip-10-0-133-49.ec2.internal\" (UID: \"1668fe2fbcb786c1ffb20c9700e9cb32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.678725 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678689 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.678725 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678679 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1668fe2fbcb786c1ffb20c9700e9cb32-config\") pod \"kube-apiserver-proxy-ip-10-0-133-49.ec2.internal\" (UID: \"1668fe2fbcb786c1ffb20c9700e9cb32\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.678786 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.678727 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d969dec10663e1e423bfa865169eb06-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal\" (UID: \"8d969dec10663e1e423bfa865169eb06\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.767101 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.767032 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.837505 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.837478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.841223 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:22.841207 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:22.867351 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.867322 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:22.967844 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:22.967807 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.068411 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.068362 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.168806 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.168784 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.208321 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.208297 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 30 20:57:23.208832 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.208434 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 30 20:57:23.269795 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.269775 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.281829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.281792 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 20:52:22 +0000 UTC" deadline="2028-04-06 17:38:12.751901674 +0000 UTC" Jul 30 20:57:23.281829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.281823 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14780h40m49.470082225s" Jul 30 20:57:23.370290 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.370226 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.413680 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:23.413648 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1668fe2fbcb786c1ffb20c9700e9cb32.slice/crio-7c91e85f92b2b6b7919ab7b0939def40209944edded8a56480d5ea36f9d83b35 WatchSource:0}: Error finding container 7c91e85f92b2b6b7919ab7b0939def40209944edded8a56480d5ea36f9d83b35: Status 404 returned error can't find the container with id 7c91e85f92b2b6b7919ab7b0939def40209944edded8a56480d5ea36f9d83b35 Jul 30 20:57:23.413981 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:23.413962 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d969dec10663e1e423bfa865169eb06.slice/crio-b22ab07b6cfc5b522846f17abb1b2d983b2890cc01b1e9d63e23da60cfeaa3b5 WatchSource:0}: Error finding container b22ab07b6cfc5b522846f17abb1b2d983b2890cc01b1e9d63e23da60cfeaa3b5: Status 404 returned error can't find the container with id b22ab07b6cfc5b522846f17abb1b2d983b2890cc01b1e9d63e23da60cfeaa3b5 Jul 30 20:57:23.419934 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.419921 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 20:57:23.470667 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.470643 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.571217 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:23.571188 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-49.ec2.internal\" not found" Jul 30 20:57:23.601400 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.601380 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 20:57:23.635287 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.635238 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 20:57:23.677503 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.677485 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" Jul 30 20:57:23.689870 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.689855 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 20:57:23.693500 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.693488 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" Jul 30 20:57:23.702828 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.702815 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 30 20:57:23.847686 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:23.847440 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 20:57:24.254527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.254501 2577 apiserver.go:52] "Watching apiserver" Jul 30 20:57:24.260886 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.260864 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 30 20:57:24.261354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.261327 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-ftb44","openshift-network-operator/iptables-alerter-c4dv8","kube-system/konnectivity-agent-v54mb","kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal","openshift-dns/node-resolver-lms86","openshift-image-registry/node-ca-8n564","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal","openshift-multus/multus-slgpz","openshift-ovn-kubernetes/ovnkube-node-m6xq5","kube-system/global-pull-secret-syncer-mm8qr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7","openshift-cluster-node-tuning-operator/tuned-n4xjr","openshift-multus/multus-additional-cni-plugins-mqkt9","openshift-multus/network-metrics-daemon-ggzpn"] Jul 30 20:57:24.263825 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.263799 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.266043 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.266377 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266356 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 30 20:57:24.266658 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 30 20:57:24.266737 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 30 20:57:24.266737 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266697 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.266737 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266715 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.266880 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.266863 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-br6zp\"" Jul 30 20:57:24.268239 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.268219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.268946 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.268924 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.268946 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.268936 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 30 20:57:24.269082 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.269026 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nn8jd\"" Jul 30 20:57:24.269189 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.269174 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.270488 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.270472 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:24.270599 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.270557 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:24.270809 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.270792 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 30 20:57:24.271096 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.271079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7qb6j\"" Jul 30 20:57:24.271193 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.271086 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 30 20:57:24.272803 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.272788 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.275064 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.275043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.275647 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.275446 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.275647 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.275528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.275647 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.275637 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qn2dq\"" Jul 30 20:57:24.276997 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.276982 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 30 20:57:24.277400 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.277383 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.277490 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.277453 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:24.277746 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.277729 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-h7524\"" Jul 30 20:57:24.278510 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.278490 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.278609 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.278494 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.278773 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.278759 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 30 20:57:24.279713 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.279695 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.283500 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.282208 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 30 20:57:24.283500 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.282500 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7l4d\"" Jul 30 20:57:24.284390 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.284372 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.287240 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287203 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qxxj6\"" Jul 30 20:57:24.287455 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287327 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/995d6002-a1d1-4284-8d98-e210674452e0-agent-certs\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.287455 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28e33746-93cc-4ca7-890a-c836fd0a1a2e-hosts-file\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.287455 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287389 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 30 20:57:24.287455 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trb7g\" (UniqueName: \"kubernetes.io/projected/28e33746-93cc-4ca7-890a-c836fd0a1a2e-kube-api-access-trb7g\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.287455 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca185b72-0eac-4af2-aec0-3bed6a3179d9-host\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287504 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287528 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f197e7bb-64d6-4373-a3e4-55ba70f3e462-iptables-alerter-script\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287545 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/995d6002-a1d1-4284-8d98-e210674452e0-konnectivity-ca\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e33746-93cc-4ca7-890a-c836fd0a1a2e-tmp-dir\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287620 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca185b72-0eac-4af2-aec0-3bed6a3179d9-serviceca\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287643 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vrq9\" (UniqueName: \"kubernetes.io/projected/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-kube-api-access-8vrq9\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.287698 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrs9\" (UniqueName: \"kubernetes.io/projected/f197e7bb-64d6-4373-a3e4-55ba70f3e462-kube-api-access-xxrs9\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmdwz\" (UniqueName: \"kubernetes.io/projected/ca185b72-0eac-4af2-aec0-3bed6a3179d9-kube-api-access-rmdwz\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287732 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-cnibin\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287753 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-os-release\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287777 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287837 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqd7d\" (UniqueName: \"kubernetes.io/projected/b908c188-aa39-4d82-83aa-4037f68d16b4-kube-api-access-xqd7d\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f197e7bb-64d6-4373-a3e4-55ba70f3e462-host-slash\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.287949 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.288141 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.288163 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 30 20:57:24.288216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.288213 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.288872 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.288314 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.288872 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.288383 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:24.289688 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.289662 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 30 20:57:24.289772 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.289762 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.292787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.292301 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.292787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.292406 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8kpvk\"" Jul 30 20:57:24.292787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.292476 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.292787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.292525 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.292787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.292647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 30 20:57:24.294932 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.294913 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 30 20:57:24.295306 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.295286 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 30 20:57:24.295483 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.295462 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4gggh\"" Jul 30 20:57:24.310222 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.310200 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p86lg" Jul 30 20:57:24.320413 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.320390 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p86lg" Jul 30 20:57:24.378164 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.378137 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 30 20:57:24.388765 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea01edd3-1419-4ccd-8542-be10b434fb62-ovn-node-metrics-cert\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.388901 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388770 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcpqg\" (UniqueName: \"kubernetes.io/projected/ea01edd3-1419-4ccd-8542-be10b434fb62-kube-api-access-fcpqg\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.388901 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388797 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-kubelet\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.388901 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-registration-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.388901 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-tmp\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-env-overrides\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388943 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-k8s-cni-cncf-io\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.388993 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-multus-certs\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-etc-selinux\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.389097 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389076 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e33746-93cc-4ca7-890a-c836fd0a1a2e-tmp-dir\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.389432 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca185b72-0eac-4af2-aec0-3bed6a3179d9-serviceca\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.389432 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389328 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-os-release\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.389527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389421 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.389527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389458 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28e33746-93cc-4ca7-890a-c836fd0a1a2e-tmp-dir\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.389527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:24.389527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389491 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-socket-dir-parent\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-modprobe-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389552 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-kubernetes\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389560 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca185b72-0eac-4af2-aec0-3bed6a3179d9-serviceca\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389639 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-lib-modules\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-os-release\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffl54\" (UniqueName: \"kubernetes.io/projected/2c440c4d-c603-43ca-893a-23db30496c2e-kube-api-access-ffl54\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.389717 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389746 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f197e7bb-64d6-4373-a3e4-55ba70f3e462-host-slash\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389843 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/995d6002-a1d1-4284-8d98-e210674452e0-agent-certs\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f197e7bb-64d6-4373-a3e4-55ba70f3e462-iptables-alerter-script\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.389968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-node-log\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390006 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-log-socket\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390063 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f197e7bb-64d6-4373-a3e4-55ba70f3e462-host-slash\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390165 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-script-lib\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390224 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-bin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390269 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrs9\" (UniqueName: \"kubernetes.io/projected/f197e7bb-64d6-4373-a3e4-55ba70f3e462-kube-api-access-xxrs9\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390292 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-systemd-units\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390225 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390316 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390339 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390341 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-os-release\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-host\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-cnibin\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390567 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f197e7bb-64d6-4373-a3e4-55ba70f3e462-iptables-alerter-script\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-multus\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390608 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-cnibin\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390718 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-hostroot\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-daemon-config\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.390793 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-device-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-etc-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390847 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-system-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390876 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-netns\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-conf-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390924 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-sys-fs\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390946 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-conf\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390967 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-run\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.390989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-slash\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391025 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28e33746-93cc-4ca7-890a-c836fd0a1a2e-hosts-file\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391026 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b908c188-aa39-4d82-83aa-4037f68d16b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391097 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/28e33746-93cc-4ca7-890a-c836fd0a1a2e-hosts-file\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391151 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trb7g\" (UniqueName: \"kubernetes.io/projected/28e33746-93cc-4ca7-890a-c836fd0a1a2e-kube-api-access-trb7g\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391178 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-ovn\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-bin\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391225 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-cnibin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgzr8\" (UniqueName: \"kubernetes.io/projected/1c2bc580-9bad-4c10-948d-a36fea4f8725-kube-api-access-sgzr8\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/995d6002-a1d1-4284-8d98-e210674452e0-konnectivity-ca\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391383 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-kubelet\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391401 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-var-lib-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-config\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391440 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-socket-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391563 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntrw\" (UniqueName: \"kubernetes.io/projected/3fc6028c-4cb7-4205-a34a-da22d247557b-kube-api-access-bntrw\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391599 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-systemd\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391628 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmdwz\" (UniqueName: \"kubernetes.io/projected/ca185b72-0eac-4af2-aec0-3bed6a3179d9-kube-api-access-rmdwz\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqd7d\" (UniqueName: \"kubernetes.io/projected/b908c188-aa39-4d82-83aa-4037f68d16b4-kube-api-access-xqd7d\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-sys\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.391864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.391775 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-var-lib-kubelet\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.392530 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392495 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/995d6002-a1d1-4284-8d98-e210674452e0-konnectivity-ca\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.392837 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-kubelet-config\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.392930 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392848 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-cni-binary-copy\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.392930 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392895 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca185b72-0eac-4af2-aec0-3bed6a3179d9-host\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.392930 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392926 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.393060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392955 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.393060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392981 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-netns\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.393060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.392995 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca185b72-0eac-4af2-aec0-3bed6a3179d9-host\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.393060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393010 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysconfig\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.393060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393052 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393075 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-etc-tuned\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vrq9\" (UniqueName: \"kubernetes.io/projected/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-kube-api-access-8vrq9\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.393129 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393177 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393210 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-systemd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-dbus\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393251 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-etc-kubernetes\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393270 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.393301 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393290 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-netd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.393700 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.393657 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:24.893631615 +0000 UTC m=+2.990857410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:24.393871 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.393849 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-system-cni-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.394048 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.394028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b908c188-aa39-4d82-83aa-4037f68d16b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.396617 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.396592 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/995d6002-a1d1-4284-8d98-e210674452e0-agent-certs\") pod \"konnectivity-agent-v54mb\" (UID: \"995d6002-a1d1-4284-8d98-e210674452e0\") " pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.396714 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.396631 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:24.396714 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.396653 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:24.396714 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.396673 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:24.396884 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.396752 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:24.896724536 +0000 UTC m=+2.993950325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:24.399094 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.399040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrs9\" (UniqueName: \"kubernetes.io/projected/f197e7bb-64d6-4373-a3e4-55ba70f3e462-kube-api-access-xxrs9\") pod \"iptables-alerter-c4dv8\" (UID: \"f197e7bb-64d6-4373-a3e4-55ba70f3e462\") " pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.399674 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.399655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trb7g\" (UniqueName: \"kubernetes.io/projected/28e33746-93cc-4ca7-890a-c836fd0a1a2e-kube-api-access-trb7g\") pod \"node-resolver-lms86\" (UID: \"28e33746-93cc-4ca7-890a-c836fd0a1a2e\") " pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.400324 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.400302 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqd7d\" (UniqueName: \"kubernetes.io/projected/b908c188-aa39-4d82-83aa-4037f68d16b4-kube-api-access-xqd7d\") pod \"multus-additional-cni-plugins-mqkt9\" (UID: \"b908c188-aa39-4d82-83aa-4037f68d16b4\") " pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.400927 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.400909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmdwz\" (UniqueName: \"kubernetes.io/projected/ca185b72-0eac-4af2-aec0-3bed6a3179d9-kube-api-access-rmdwz\") pod \"node-ca-8n564\" (UID: \"ca185b72-0eac-4af2-aec0-3bed6a3179d9\") " pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.404474 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.404426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vrq9\" (UniqueName: \"kubernetes.io/projected/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-kube-api-access-8vrq9\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.408500 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.408455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" event={"ID":"1668fe2fbcb786c1ffb20c9700e9cb32","Type":"ContainerStarted","Data":"7c91e85f92b2b6b7919ab7b0939def40209944edded8a56480d5ea36f9d83b35"} Jul 30 20:57:24.409593 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.409569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" event={"ID":"8d969dec10663e1e423bfa865169eb06","Type":"ContainerStarted","Data":"b22ab07b6cfc5b522846f17abb1b2d983b2890cc01b1e9d63e23da60cfeaa3b5"} Jul 30 20:57:24.494103 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494071 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-kubelet\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494124 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-var-lib-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-config\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494176 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494175 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-kubelet\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494198 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-socket-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-var-lib-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntrw\" (UniqueName: \"kubernetes.io/projected/3fc6028c-4cb7-4205-a34a-da22d247557b-kube-api-access-bntrw\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494300 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494301 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-systemd\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-sys\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494357 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-systemd\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494364 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-var-lib-kubelet\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494384 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-sys\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-kubelet-config\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494404 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-var-lib-kubelet\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494424 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-cni-binary-copy\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494426 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-socket-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-kubelet-config\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494452 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-netns\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494476 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysconfig\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-netns\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494544 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysconfig\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-etc-tuned\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.494630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494601 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-systemd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-dbus\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494644 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-etc-kubernetes\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494698 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-systemd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494740 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-etc-kubernetes\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494820 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-config\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-dbus\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494874 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494907 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-netd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea01edd3-1419-4ccd-8542-be10b434fb62-ovn-node-metrics-cert\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494934 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-cni-binary-copy\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.494975 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-netd\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495000 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcpqg\" (UniqueName: \"kubernetes.io/projected/ea01edd3-1419-4ccd-8542-be10b434fb62-kube-api-access-fcpqg\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-kubelet\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495157 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-kubelet\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495184 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-registration-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.495525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-tmp\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495217 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-env-overrides\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-k8s-cni-cncf-io\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495269 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-registration-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495294 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-multus-certs\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-etc-selinux\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.495364 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.495405 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:24.995391919 +0000 UTC m=+3.092617693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495399 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-socket-dir-parent\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495455 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-k8s-cni-cncf-io\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495495 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-multus-certs\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-socket-dir-parent\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495556 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-modprobe-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495578 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-kubernetes\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-lib-modules\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495606 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-env-overrides\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.496385 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffl54\" (UniqueName: \"kubernetes.io/projected/2c440c4d-c603-43ca-893a-23db30496c2e-kube-api-access-ffl54\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495648 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-kubernetes\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-node-log\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495669 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-modprobe-d\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495612 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-etc-selinux\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495686 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-log-socket\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495744 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-node-log\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495736 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-lib-modules\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-script-lib\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495787 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-log-socket\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-bin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495826 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-systemd-units\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495828 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495863 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495886 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-bin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495892 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497258 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495865 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-systemd-units\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495890 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-os-release\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.495981 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-host\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-multus\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496011 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496029 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-hostroot\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-os-release\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-daemon-config\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-var-lib-cni-multus\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496079 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-hostroot\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-device-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-host\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496131 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-etc-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-device-dir\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496155 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-system-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-netns\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496180 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-etc-openvswitch\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.497822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496191 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ea01edd3-1419-4ccd-8542-be10b434fb62-ovnkube-script-lib\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-conf-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496227 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-system-cni-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496238 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-conf-dir\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-sys-fs\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496249 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-host-run-netns\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-conf\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-run\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-slash\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-ovn\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-run\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496314 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3fc6028c-4cb7-4205-a34a-da22d247557b-sys-fs\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496427 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-slash\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496432 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-run-ovn\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-bin\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496386 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ea01edd3-1419-4ccd-8542-be10b434fb62-host-cni-bin\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496459 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2c440c4d-c603-43ca-893a-23db30496c2e-etc-sysctl-conf\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-cnibin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgzr8\" (UniqueName: \"kubernetes.io/projected/1c2bc580-9bad-4c10-948d-a36fea4f8725-kube-api-access-sgzr8\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496551 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c2bc580-9bad-4c10-948d-a36fea4f8725-cnibin\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.496604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1c2bc580-9bad-4c10-948d-a36fea4f8725-multus-daemon-config\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.498998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.497605 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ea01edd3-1419-4ccd-8542-be10b434fb62-ovn-node-metrics-cert\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.498998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.498102 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-etc-tuned\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.498998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.498308 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c440c4d-c603-43ca-893a-23db30496c2e-tmp\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.503985 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.503958 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntrw\" (UniqueName: \"kubernetes.io/projected/3fc6028c-4cb7-4205-a34a-da22d247557b-kube-api-access-bntrw\") pod \"aws-ebs-csi-driver-node-679n7\" (UID: \"3fc6028c-4cb7-4205-a34a-da22d247557b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.504836 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.504778 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffl54\" (UniqueName: \"kubernetes.io/projected/2c440c4d-c603-43ca-893a-23db30496c2e-kube-api-access-ffl54\") pod \"tuned-n4xjr\" (UID: \"2c440c4d-c603-43ca-893a-23db30496c2e\") " pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.504952 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.504936 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgzr8\" (UniqueName: \"kubernetes.io/projected/1c2bc580-9bad-4c10-948d-a36fea4f8725-kube-api-access-sgzr8\") pod \"multus-slgpz\" (UID: \"1c2bc580-9bad-4c10-948d-a36fea4f8725\") " pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.505405 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.505385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcpqg\" (UniqueName: \"kubernetes.io/projected/ea01edd3-1419-4ccd-8542-be10b434fb62-kube-api-access-fcpqg\") pod \"ovnkube-node-m6xq5\" (UID: \"ea01edd3-1419-4ccd-8542-be10b434fb62\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.575278 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.575248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" Jul 30 20:57:24.584957 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.584936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c4dv8" Jul 30 20:57:24.595009 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.594988 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:24.602691 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.602668 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:24.609241 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.609222 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lms86" Jul 30 20:57:24.617752 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.617732 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n564" Jul 30 20:57:24.625346 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.625329 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-slgpz" Jul 30 20:57:24.631962 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.631940 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" Jul 30 20:57:24.636483 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.636464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" Jul 30 20:57:24.674280 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.674250 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 30 20:57:24.899223 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.899139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:24.899372 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:24.899230 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:24.899372 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899309 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:24.899372 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899333 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:24.899372 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899346 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:24.899566 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899375 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:24.899566 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899404 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:25.899386893 +0000 UTC m=+3.996612678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:24.899566 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:24.899432 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:25.899418177 +0000 UTC m=+3.996643947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:25.000486 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.000458 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:25.000640 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.000600 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:25.000681 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.000662 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:26.000647447 +0000 UTC m=+4.097873244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:25.323528 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.323498 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:52:24 +0000 UTC" deadline="2028-02-24 04:56:25.167567083 +0000 UTC" Jul 30 20:57:25.323528 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.323523 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13759h58m59.844046525s" Jul 30 20:57:25.340676 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:25.340637 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c440c4d_c603_43ca_893a_23db30496c2e.slice/crio-e9a296f0c5a7ec8bc5015b6d8bdd2a0d26f6fba7804cfb79c1d2a90828b551bd WatchSource:0}: Error finding container e9a296f0c5a7ec8bc5015b6d8bdd2a0d26f6fba7804cfb79c1d2a90828b551bd: Status 404 returned error can't find the container with id e9a296f0c5a7ec8bc5015b6d8bdd2a0d26f6fba7804cfb79c1d2a90828b551bd Jul 30 20:57:25.341284 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:25.341216 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf197e7bb_64d6_4373_a3e4_55ba70f3e462.slice/crio-3bb1e36587f38e06168778b60ee03dbd0036536fb621acc6deded7339c657dc6 WatchSource:0}: Error finding container 3bb1e36587f38e06168778b60ee03dbd0036536fb621acc6deded7339c657dc6: Status 404 returned error can't find the container with id 3bb1e36587f38e06168778b60ee03dbd0036536fb621acc6deded7339c657dc6 Jul 30 20:57:25.366233 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:25.366208 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea01edd3_1419_4ccd_8542_be10b434fb62.slice/crio-4b06f6907599188ecd7088eac8fcdc1fc3804455ba8e4659d0e4e1f229c148c8 WatchSource:0}: Error finding container 4b06f6907599188ecd7088eac8fcdc1fc3804455ba8e4659d0e4e1f229c148c8: Status 404 returned error can't find the container with id 4b06f6907599188ecd7088eac8fcdc1fc3804455ba8e4659d0e4e1f229c148c8 Jul 30 20:57:25.366792 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:25.366735 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995d6002_a1d1_4284_8d98_e210674452e0.slice/crio-fad7bd323bc7075bc38b4fcd911b7fddbfadc48452fac3accefb203a9207feff WatchSource:0}: Error finding container fad7bd323bc7075bc38b4fcd911b7fddbfadc48452fac3accefb203a9207feff: Status 404 returned error can't find the container with id fad7bd323bc7075bc38b4fcd911b7fddbfadc48452fac3accefb203a9207feff Jul 30 20:57:25.368184 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:25.368104 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca185b72_0eac_4af2_aec0_3bed6a3179d9.slice/crio-0ce68ccc9c8c10c146e8c1c2886f5ce4c10f50313144966fab46ad412b173aa1 WatchSource:0}: Error finding container 0ce68ccc9c8c10c146e8c1c2886f5ce4c10f50313144966fab46ad412b173aa1: Status 404 returned error can't find the container with id 0ce68ccc9c8c10c146e8c1c2886f5ce4c10f50313144966fab46ad412b173aa1 Jul 30 20:57:25.416744 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.416577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n564" event={"ID":"ca185b72-0eac-4af2-aec0-3bed6a3179d9","Type":"ContainerStarted","Data":"0ce68ccc9c8c10c146e8c1c2886f5ce4c10f50313144966fab46ad412b173aa1"} Jul 30 20:57:25.417496 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.417476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v54mb" event={"ID":"995d6002-a1d1-4284-8d98-e210674452e0","Type":"ContainerStarted","Data":"fad7bd323bc7075bc38b4fcd911b7fddbfadc48452fac3accefb203a9207feff"} Jul 30 20:57:25.418432 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.418403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"4b06f6907599188ecd7088eac8fcdc1fc3804455ba8e4659d0e4e1f229c148c8"} Jul 30 20:57:25.419709 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.419424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" event={"ID":"2c440c4d-c603-43ca-893a-23db30496c2e","Type":"ContainerStarted","Data":"e9a296f0c5a7ec8bc5015b6d8bdd2a0d26f6fba7804cfb79c1d2a90828b551bd"} Jul 30 20:57:25.420599 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.420578 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slgpz" event={"ID":"1c2bc580-9bad-4c10-948d-a36fea4f8725","Type":"ContainerStarted","Data":"502819008b73129d7b927d357753a27bdc418c9733512f16f146360ec556f8cb"} Jul 30 20:57:25.421823 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.421789 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" event={"ID":"3fc6028c-4cb7-4205-a34a-da22d247557b","Type":"ContainerStarted","Data":"b595caa4000e5ae7dff7526995538280c41c0ab43824de1dbaa9901e70419872"} Jul 30 20:57:25.423058 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.423036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerStarted","Data":"741014ab2f741bdf8bad3743e289d161d3f81b24701c19abcf562729e1f0a013"} Jul 30 20:57:25.424491 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.424475 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lms86" event={"ID":"28e33746-93cc-4ca7-890a-c836fd0a1a2e","Type":"ContainerStarted","Data":"6c0062bcbd7117cb982dc65f61b72581821f4e8f82943f0a2518910edc9189bf"} Jul 30 20:57:25.425515 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.425493 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4dv8" event={"ID":"f197e7bb-64d6-4373-a3e4-55ba70f3e462","Type":"ContainerStarted","Data":"3bb1e36587f38e06168778b60ee03dbd0036536fb621acc6deded7339c657dc6"} Jul 30 20:57:25.905513 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.905430 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:25.905667 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:25.905553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:25.905730 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.905706 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:25.905781 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.905769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:27.905748314 +0000 UTC m=+6.002974100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:25.906202 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.906183 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:25.906288 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.906207 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:25.906288 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.906220 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:25.906288 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:25.906271 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:27.906249525 +0000 UTC m=+6.003475299 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:26.006876 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.006837 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:26.007057 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:26.007047 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:26.007141 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:26.007125 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:28.007094142 +0000 UTC m=+6.104319920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:26.323756 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.323699 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 20:52:24 +0000 UTC" deadline="2028-01-01 07:27:28.083522714 +0000 UTC" Jul 30 20:57:26.323756 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.323752 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12466h30m1.75977459s" Jul 30 20:57:26.414790 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.414763 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:26.414930 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:26.414885 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:26.415399 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.415379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:26.415514 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:26.415494 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:26.415586 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.415558 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:26.415659 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:26.415643 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:26.436292 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.436256 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" event={"ID":"1668fe2fbcb786c1ffb20c9700e9cb32","Type":"ContainerStarted","Data":"0a7c2913cb2356d56c5c0dff9cb17a9fa75eb33f05ca3ee91988beea32aedebd"} Jul 30 20:57:26.444299 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.444271 2577 generic.go:356] "Generic (PLEG): container finished" podID="8d969dec10663e1e423bfa865169eb06" containerID="60d0a81fe64cdff140d57c0a5d266a9986fd5a14a84505d64bf863733b655d9e" exitCode=0 Jul 30 20:57:26.444403 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.444314 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" event={"ID":"8d969dec10663e1e423bfa865169eb06","Type":"ContainerDied","Data":"60d0a81fe64cdff140d57c0a5d266a9986fd5a14a84505d64bf863733b655d9e"} Jul 30 20:57:26.468513 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:26.468466 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-49.ec2.internal" podStartSLOduration=3.468447832 podStartE2EDuration="3.468447832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:26.4532028 +0000 UTC m=+4.550428596" watchObservedRunningTime="2026-07-30 20:57:26.468447832 +0000 UTC m=+4.565673626" Jul 30 20:57:27.466538 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:27.466497 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" event={"ID":"8d969dec10663e1e423bfa865169eb06","Type":"ContainerStarted","Data":"60e28d0b4da68418d8f10c63789c1ba3f17070d82590edbeb548ce88f5e1f2c8"} Jul 30 20:57:27.923247 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:27.923167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:27.923411 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:27.923254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:27.923411 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923397 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:27.923516 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923457 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:31.923438961 +0000 UTC m=+10.020664732 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:27.923581 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923543 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:27.923581 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923557 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:27.923581 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923569 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:27.923730 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:27.923608 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:31.923594711 +0000 UTC m=+10.020820481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:28.024528 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:28.024490 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:28.024704 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:28.024642 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:28.024704 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:28.024704 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:32.024685513 +0000 UTC m=+10.121911289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:28.405950 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:28.406108 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:28.406584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:28.406597 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:28.406687 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:28.406829 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:28.406761 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:30.404617 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:30.404756 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:30.404763 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:30.404884 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:30.404937 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:30.405162 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:30.405015 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:31.955025 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:31.954991 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:31.955063 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955156 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955209 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955229 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955240 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955216 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:39.955201132 +0000 UTC m=+18.052426903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:31.955493 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:31.955316 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:39.955289534 +0000 UTC m=+18.052515321 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:32.056242 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:32.056208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:32.056399 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:32.056361 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:32.056474 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:32.056435 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:40.056415587 +0000 UTC m=+18.153641360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:32.404865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:32.404776 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:32.405035 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:32.404914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:32.405035 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:32.405018 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:32.405189 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:32.404912 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:32.405189 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:32.405089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:32.405298 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:32.405184 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:34.403497 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:34.403455 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:34.403967 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:34.403474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:34.403967 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:34.403586 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:34.403967 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:34.403607 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:34.403967 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:34.403712 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:34.403967 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:34.403798 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:36.403716 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:36.403643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:36.403716 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:36.403643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:36.403716 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:36.403686 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:36.404282 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:36.403793 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:36.404282 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:36.403807 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:36.404282 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:36.403867 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:38.404071 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:38.404036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:38.404071 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:38.404082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:38.404612 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:38.404036 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:38.404612 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:38.404186 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:38.404612 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:38.404266 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:38.404612 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:38.404349 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:40.023931 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.023885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.023962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024065 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024098 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024123 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024071 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024178 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:56.024160186 +0000 UTC m=+34.121385965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:40.024400 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.024227 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:56.024209017 +0000 UTC m=+34.121434791 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:40.124921 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.124885 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:40.125088 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.125060 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:40.125215 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.125144 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:56.125122729 +0000 UTC m=+34.222348516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:40.403564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.403453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:40.403564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.403491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:40.403564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:40.403453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:40.403808 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.403586 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:40.403808 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.403651 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:40.403808 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:40.403713 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:42.403947 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:42.403916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:42.404427 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:42.404025 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:42.404427 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:42.404032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:42.404427 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:42.404092 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:42.404427 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:42.404126 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:42.404427 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:42.404202 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:44.404569 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.404108 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:44.405273 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.404107 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:44.405273 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:44.404701 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:44.405273 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.404163 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:44.405273 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:44.404756 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:44.405273 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:44.404807 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:44.503603 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.502906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n564" event={"ID":"ca185b72-0eac-4af2-aec0-3bed6a3179d9","Type":"ContainerStarted","Data":"888e3f00c9133f0736ef18b7205cdb49adf7583c3144b64c473c4e586fdbc49e"} Jul 30 20:57:44.505214 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.504808 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v54mb" event={"ID":"995d6002-a1d1-4284-8d98-e210674452e0","Type":"ContainerStarted","Data":"d41c5646a59c2d09a821bbfbce90488ea19704f121f697bdd743e6a90a0e99f8"} Jul 30 20:57:44.508239 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508221 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 20:57:44.508579 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508558 2577 generic.go:356] "Generic (PLEG): container finished" podID="ea01edd3-1419-4ccd-8542-be10b434fb62" containerID="b6165f0f65c59ef308a38102bdf126776190853f2a26f65cc0044bfd58bba7f2" exitCode=1 Jul 30 20:57:44.508684 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508637 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"50220d5f0a8aec690326f75b08811b88794293495583059cede2ff1fc918cd65"} Jul 30 20:57:44.508848 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508704 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"f31980614d3fc86ae04084abe45e03691a536ba1111bdc9a000e0fc67d341a98"} Jul 30 20:57:44.508848 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"1e5ac5378b2518c5d13e7bc96a42b842a4c6d23b59e6eccf5ff2e166b33c7086"} Jul 30 20:57:44.508848 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"8271a53d6a718e3ce8bad093523cae384e4e23f314162ce4698661c290701a7d"} Jul 30 20:57:44.508848 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508846 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerDied","Data":"b6165f0f65c59ef308a38102bdf126776190853f2a26f65cc0044bfd58bba7f2"} Jul 30 20:57:44.509085 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.508895 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"4bc70425af66501a62c023a9158d36ed9d8f78d7bed7eecffb674cbc735219ea"} Jul 30 20:57:44.510642 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.510614 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" event={"ID":"2c440c4d-c603-43ca-893a-23db30496c2e","Type":"ContainerStarted","Data":"48455dcff6d46b1289e10ccf7cc0bcb95f3383e4428b7721b0958c8f2b0345ea"} Jul 30 20:57:44.512247 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.512223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-slgpz" event={"ID":"1c2bc580-9bad-4c10-948d-a36fea4f8725","Type":"ContainerStarted","Data":"9aed3c10102da1d46722c99ca1ce31f0ba17247fe676be4263b4f82674463538"} Jul 30 20:57:44.513801 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.513780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" event={"ID":"3fc6028c-4cb7-4205-a34a-da22d247557b","Type":"ContainerStarted","Data":"3c0b1ab9a08de18738255701469a1d4f748abf6ab3332edf251740e7d9dfdb69"} Jul 30 20:57:44.515732 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.515707 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="3d7eff41575655f89e32e017e4a4ccdb175241016ac1c360201fcd32b879fb22" exitCode=0 Jul 30 20:57:44.515835 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.515774 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"3d7eff41575655f89e32e017e4a4ccdb175241016ac1c360201fcd32b879fb22"} Jul 30 20:57:44.517750 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.517379 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lms86" event={"ID":"28e33746-93cc-4ca7-890a-c836fd0a1a2e","Type":"ContainerStarted","Data":"ddd471a2adb6d16cb87cf461477aea512f31667a80895632b6a558128359b928"} Jul 30 20:57:44.519781 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.519736 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8n564" podStartSLOduration=4.428594739 podStartE2EDuration="22.519720804s" totalImagesPullingTime="18.091126065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:44.518926959 +0000 UTC m=+22.616152780" watchObservedRunningTime="2026-07-30 20:57:44.519720804 +0000 UTC m=+22.616946599" Jul 30 20:57:44.519873 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.519831 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-49.ec2.internal" podStartSLOduration=21.51982387 podStartE2EDuration="21.51982387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:27.483768263 +0000 UTC m=+5.580994057" watchObservedRunningTime="2026-07-30 20:57:44.51982387 +0000 UTC m=+22.617049665" Jul 30 20:57:44.534614 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.534570 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lms86" podStartSLOduration=4.437724489 podStartE2EDuration="22.534554707s" totalImagesPullingTime="18.096830218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:44.534141267 +0000 UTC m=+22.631367075" watchObservedRunningTime="2026-07-30 20:57:44.534554707 +0000 UTC m=+22.631780500" Jul 30 20:57:44.555351 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.555312 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-slgpz" podStartSLOduration=4.402056864 podStartE2EDuration="22.555298593s" totalImagesPullingTime="18.153241729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:44.554951636 +0000 UTC m=+22.652177454" watchObservedRunningTime="2026-07-30 20:57:44.555298593 +0000 UTC m=+22.652524386" Jul 30 20:57:44.576484 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.576438 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n4xjr" podStartSLOduration=4.456165665 podStartE2EDuration="22.576424439s" totalImagesPullingTime="18.120258774s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:44.576377672 +0000 UTC m=+22.673603465" watchObservedRunningTime="2026-07-30 20:57:44.576424439 +0000 UTC m=+22.673650232" Jul 30 20:57:44.616582 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.616534 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v54mb" podStartSLOduration=8.865795099 podStartE2EDuration="22.616518888s" totalImagesPullingTime="13.750723789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:44.616502424 +0000 UTC m=+22.713728216" watchObservedRunningTime="2026-07-30 20:57:44.616518888 +0000 UTC m=+22.713744681" Jul 30 20:57:44.958408 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:44.958364 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 30 20:57:45.353540 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.353436 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T20:57:44.958388215Z","UUID":"5c525110-ed87-49be-8a21-374aebd0a22c","Handler":null,"Name":"","Endpoint":""} Jul 30 20:57:45.354898 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.354880 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 30 20:57:45.355008 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.354912 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 30 20:57:45.522437 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.522401 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" event={"ID":"3fc6028c-4cb7-4205-a34a-da22d247557b","Type":"ContainerStarted","Data":"f674e9e6e73b4584754a4f27d18f289628105caf4764d628728cafe60eaec084"} Jul 30 20:57:45.524475 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.524445 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c4dv8" event={"ID":"f197e7bb-64d6-4373-a3e4-55ba70f3e462","Type":"ContainerStarted","Data":"61ceb9522556b6763738e924665ae8d3e8b2aa3a9f8a39e732d7fd1a387f26cb"} Jul 30 20:57:45.542137 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:45.542074 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c4dv8" podStartSLOduration=5.445173324 podStartE2EDuration="23.542058779s" totalImagesPullingTime="18.096885455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:45.541303065 +0000 UTC m=+23.638528861" watchObservedRunningTime="2026-07-30 20:57:45.542058779 +0000 UTC m=+23.639284572" Jul 30 20:57:46.126131 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.125874 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:46.126501 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.126481 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:46.403530 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.403453 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:46.403700 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.403575 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:46.403700 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:46.403584 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:46.403820 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:46.403702 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:46.403820 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.403726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:46.403913 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:46.403851 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:46.532766 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.532723 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" event={"ID":"3fc6028c-4cb7-4205-a34a-da22d247557b","Type":"ContainerStarted","Data":"d2b1a78e233400b3949a1bccf86c3c18e66e6b2fc00751851a9e29d02b0ae3c0"} Jul 30 20:57:46.533141 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.532843 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:46.533586 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.533565 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v54mb" Jul 30 20:57:46.552610 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:46.552557 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-679n7" podStartSLOduration=4.065793694 podStartE2EDuration="24.552533758s" totalImagesPullingTime="20.486740064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:46.55228005 +0000 UTC m=+24.649505870" watchObservedRunningTime="2026-07-30 20:57:46.552533758 +0000 UTC m=+24.649759551" Jul 30 20:57:47.538334 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:47.538310 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 20:57:47.538999 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:47.538721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"92848c5f052bf5900abfc23feb7c2b8ebc748e318c655a9ce606e1b31aa793e3"} Jul 30 20:57:48.404045 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:48.404013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:48.404239 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:48.404013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:48.404239 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:48.404176 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:48.404239 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:48.404013 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:48.404239 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:48.404220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:48.404420 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:48.404292 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:49.544836 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.544642 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="d181730ad006090009fe11dd18d9ad2905ebb9f2aa9c1a46a0cf87edcca508df" exitCode=0 Jul 30 20:57:49.545480 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.544722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"d181730ad006090009fe11dd18d9ad2905ebb9f2aa9c1a46a0cf87edcca508df"} Jul 30 20:57:49.549992 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.549973 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 20:57:49.550384 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.550361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"34ea9da4729573574230bbe64fde9b7020384d334f22767367d53fb5721a5842"} Jul 30 20:57:49.550724 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.550706 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:49.550809 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.550798 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:49.550873 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.550852 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:49.550922 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.550884 2577 scope.go:117] "RemoveContainer" containerID="b6165f0f65c59ef308a38102bdf126776190853f2a26f65cc0044bfd58bba7f2" Jul 30 20:57:49.569420 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.569396 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:49.570620 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:49.570600 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:57:50.403525 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.403447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:50.403697 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.403447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:50.403697 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.403454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:50.403697 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.403614 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:50.403697 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.403684 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:50.403896 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.403764 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:50.556329 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.556100 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 20:57:50.556758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.556687 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" event={"ID":"ea01edd3-1419-4ccd-8542-be10b434fb62","Type":"ContainerStarted","Data":"c3d369bffc2187cd68cac0abe549396769d5d4c45a8aac7c450542502fadac3e"} Jul 30 20:57:50.588794 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.588746 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" podStartSLOduration=10.139605291 podStartE2EDuration="28.588730257s" totalImagesPullingTime="18.449124966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:57:50.587015719 +0000 UTC m=+28.684241534" watchObservedRunningTime="2026-07-30 20:57:50.588730257 +0000 UTC m=+28.685956050" Jul 30 20:57:50.722789 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.722765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftb44"] Jul 30 20:57:50.722921 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.722873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:50.723010 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.722980 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:50.725941 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.725919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggzpn"] Jul 30 20:57:50.726087 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.726040 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:50.726198 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.726174 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:50.741011 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.739322 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mm8qr"] Jul 30 20:57:50.741011 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:50.739474 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:50.741011 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:50.739594 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:51.560426 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:51.560389 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="fabfac68be504bb2d97c76b0fffbb9eeef9242457d773f7d83387593752d190f" exitCode=0 Jul 30 20:57:51.560834 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:51.560468 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"fabfac68be504bb2d97c76b0fffbb9eeef9242457d773f7d83387593752d190f"} Jul 30 20:57:52.405299 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:52.405258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:52.405471 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:52.405368 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:52.405471 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:52.405399 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:52.405471 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:52.405400 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:52.405581 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:52.405473 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:52.405581 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:52.405553 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:53.566318 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:53.566277 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="b511ce47b4ea38521c87d175d073b9950603c583accbe33b4496f92a7a4eb8a7" exitCode=0 Jul 30 20:57:53.566967 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:53.566331 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"b511ce47b4ea38521c87d175d073b9950603c583accbe33b4496f92a7a4eb8a7"} Jul 30 20:57:54.403946 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:54.403914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:54.404142 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:54.403914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:54.404142 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:54.404058 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:54.404142 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:54.404052 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:54.404142 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:54.404134 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:54.404363 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:54.404229 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:56.046673 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.046644 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.046702 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046801 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046828 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046845 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046858 2577 projected.go:196] Error preparing data for projected volume kube-api-access-kcwrm for pod openshift-network-diagnostics/network-check-target-ftb44: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046874 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs podName:d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:28.046854212 +0000 UTC m=+66.144079984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs") pod "network-metrics-daemon-ggzpn" (UID: "d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 30 20:57:56.047107 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.046905 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm podName:2ebfc622-bde7-4296-ac4a-1951568e9855 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:28.046889904 +0000 UTC m=+66.144115689 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kcwrm" (UniqueName: "kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm") pod "network-check-target-ftb44" (UID: "2ebfc622-bde7-4296-ac4a-1951568e9855") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 30 20:57:56.147489 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.147456 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:56.147646 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.147600 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:56.147701 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.147663 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret podName:ef8ae32e-73f5-4f4b-9cdb-f641607576b8 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:28.147645126 +0000 UTC m=+66.244870909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret") pod "global-pull-secret-syncer-mm8qr" (UID: "ef8ae32e-73f5-4f4b-9cdb-f641607576b8") : object "kube-system"/"original-pull-secret" not registered Jul 30 20:57:56.403554 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.403478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:56.403554 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.403515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:56.403763 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:56.403593 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:56.403763 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.403603 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mm8qr" podUID="ef8ae32e-73f5-4f4b-9cdb-f641607576b8" Jul 30 20:57:56.403763 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.403700 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggzpn" podUID="d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57" Jul 30 20:57:56.403923 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:56.403778 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ftb44" podUID="2ebfc622-bde7-4296-ac4a-1951568e9855" Jul 30 20:57:57.195056 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.195026 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-49.ec2.internal" event="NodeReady" Jul 30 20:57:57.195495 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.195187 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 30 20:57:57.237511 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.237481 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hdj8x"] Jul 30 20:57:57.239951 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.239932 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.241494 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.241471 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v6th8"] Jul 30 20:57:57.242620 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.242576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77cz9\"" Jul 30 20:57:57.242620 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.242576 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 30 20:57:57.242773 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.242666 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 30 20:57:57.243219 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.243194 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.245580 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.245562 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xbdm8\"" Jul 30 20:57:57.245880 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.245851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 30 20:57:57.245974 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.245857 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 30 20:57:57.245974 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.245891 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 30 20:57:57.250838 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.250817 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hdj8x"] Jul 30 20:57:57.254077 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.254030 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6th8"] Jul 30 20:57:57.356731 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356655 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.356731 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356699 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-config-volume\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.356908 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4999865-691c-47a9-b861-11d7f8e0544f-cert\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.356908 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356830 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-tmp-dir\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.356908 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kr8l\" (UniqueName: \"kubernetes.io/projected/d4999865-691c-47a9-b861-11d7f8e0544f-kube-api-access-7kr8l\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.357018 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.356927 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g4xq\" (UniqueName: \"kubernetes.io/projected/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-kube-api-access-2g4xq\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.457236 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457200 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kr8l\" (UniqueName: \"kubernetes.io/projected/d4999865-691c-47a9-b861-11d7f8e0544f-kube-api-access-7kr8l\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.457236 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457231 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g4xq\" (UniqueName: \"kubernetes.io/projected/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-kube-api-access-2g4xq\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.457458 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.457458 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457307 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-config-volume\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.457458 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457348 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4999865-691c-47a9-b861-11d7f8e0544f-cert\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.457458 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457370 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-tmp-dir\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.457706 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:57.457542 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:57:57.457706 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:57.457619 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:57.957598118 +0000 UTC m=+36.054823906 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:57:57.457706 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457698 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-tmp-dir\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.458003 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.457979 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-config-volume\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.461988 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.461838 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4999865-691c-47a9-b861-11d7f8e0544f-cert\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.466754 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.466735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g4xq\" (UniqueName: \"kubernetes.io/projected/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-kube-api-access-2g4xq\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.466964 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.466928 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kr8l\" (UniqueName: \"kubernetes.io/projected/d4999865-691c-47a9-b861-11d7f8e0544f-kube-api-access-7kr8l\") pod \"ingress-canary-v6th8\" (UID: \"d4999865-691c-47a9-b861-11d7f8e0544f\") " pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.560079 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.560049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v6th8" Jul 30 20:57:57.959900 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:57.959872 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:57.960046 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:57.959992 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:57:57.960094 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:57.960075 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:57:58.960045497 +0000 UTC m=+37.057271268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:57:58.075866 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.075841 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v6th8"] Jul 30 20:57:58.079180 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:57:58.079157 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4999865_691c_47a9_b861_11d7f8e0544f.slice/crio-784bf207205e6c7665c584209793315bef3f53149eae106062e78cee2559f315 WatchSource:0}: Error finding container 784bf207205e6c7665c584209793315bef3f53149eae106062e78cee2559f315: Status 404 returned error can't find the container with id 784bf207205e6c7665c584209793315bef3f53149eae106062e78cee2559f315 Jul 30 20:57:58.404227 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.404196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:57:58.404633 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.404196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:57:58.404633 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.404201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:57:58.408742 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xh5pq\"" Jul 30 20:57:58.408865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66vkk\"" Jul 30 20:57:58.408865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408765 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 20:57:58.408865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408721 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 20:57:58.408865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408781 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 20:57:58.408865 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.408726 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 20:57:58.582333 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.582288 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="e7ca6cf6874dc8b727028da7c891b02a706ea7c0ffcb903dfce0de3adcaf7519" exitCode=0 Jul 30 20:57:58.582514 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.582489 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"e7ca6cf6874dc8b727028da7c891b02a706ea7c0ffcb903dfce0de3adcaf7519"} Jul 30 20:57:58.585812 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.585784 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6th8" event={"ID":"d4999865-691c-47a9-b861-11d7f8e0544f","Type":"ContainerStarted","Data":"784bf207205e6c7665c584209793315bef3f53149eae106062e78cee2559f315"} Jul 30 20:57:58.966930 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:58.966676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:57:58.967068 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:58.966823 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:57:58.967068 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:57:58.967008 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:00.966988542 +0000 UTC m=+39.064214318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:57:59.591751 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:59.591713 2577 generic.go:356] "Generic (PLEG): container finished" podID="b908c188-aa39-4d82-83aa-4037f68d16b4" containerID="77f0f820dabf50128e2c7298e9eaac559660318341f3f0ced3ace8ee17eacd94" exitCode=0 Jul 30 20:57:59.591751 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:57:59.591750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerDied","Data":"77f0f820dabf50128e2c7298e9eaac559660318341f3f0ced3ace8ee17eacd94"} Jul 30 20:58:00.596567 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:00.596532 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" event={"ID":"b908c188-aa39-4d82-83aa-4037f68d16b4","Type":"ContainerStarted","Data":"ce23f8d8b78249fd173b5af6d9bf2d8a0d5ccfa453c45b1250dad688bdb2ecff"} Jul 30 20:58:00.597960 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:00.597936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v6th8" event={"ID":"d4999865-691c-47a9-b861-11d7f8e0544f","Type":"ContainerStarted","Data":"13110076ba40fc489e71844a73a6600ac79266d0b27ef9d0950a0971a2160fd3"} Jul 30 20:58:00.619166 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:00.619101 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mqkt9" podStartSLOduration=9.796031249 podStartE2EDuration="38.619085991s" totalImagesPullingTime="28.823054742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:00.617509434 +0000 UTC m=+38.714735227" watchObservedRunningTime="2026-07-30 20:58:00.619085991 +0000 UTC m=+38.716311782" Jul 30 20:58:00.633923 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:00.633883 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v6th8" podStartSLOduration=1.5729945239999998 podStartE2EDuration="3.633870943s" totalImagesPullingTime="2.060876419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:00.633108597 +0000 UTC m=+38.730334413" watchObservedRunningTime="2026-07-30 20:58:00.633870943 +0000 UTC m=+38.731096735" Jul 30 20:58:00.981771 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:00.981694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:00.981904 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:00.981805 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:58:00.981904 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:00.981853 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:04.98183982 +0000 UTC m=+43.079065591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:58:05.009586 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.009550 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:05.009921 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:05.009684 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:58:05.009921 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:05.009741 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:13.009725652 +0000 UTC m=+51.106951430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:58:05.510352 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.510327 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj"] Jul 30 20:58:05.539415 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.539392 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj"] Jul 30 20:58:05.539543 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.539423 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g"] Jul 30 20:58:05.539543 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.539498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" Jul 30 20:58:05.542372 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.542349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x4c4t\"" Jul 30 20:58:05.544080 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.544068 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 30 20:58:05.544170 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.544153 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 30 20:58:05.572257 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.572232 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g"] Jul 30 20:58:05.572346 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.572319 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.575382 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.575363 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 30 20:58:05.575472 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.575436 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 30 20:58:05.575530 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.575414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 30 20:58:05.575530 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.575399 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 30 20:58:05.575872 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.575853 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zvfzk\"" Jul 30 20:58:05.615479 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.615458 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx"] Jul 30 20:58:05.628299 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.628280 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ntjch"] Jul 30 20:58:05.628395 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.628381 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.631213 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.631197 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2j42z\"" Jul 30 20:58:05.631311 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.631219 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 30 20:58:05.631311 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.631258 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 30 20:58:05.631563 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.631547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 30 20:58:05.631621 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.631607 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 30 20:58:05.642389 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.642372 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx"] Jul 30 20:58:05.642470 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.642400 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ntjch"] Jul 30 20:58:05.642470 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.642461 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.644943 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.644927 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 30 20:58:05.644943 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.644934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 30 20:58:05.645150 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.645136 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-brv4d\"" Jul 30 20:58:05.713027 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.713006 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-tpn89"] Jul 30 20:58:05.714582 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.714565 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jblwj\" (UniqueName: \"kubernetes.io/projected/13172577-97de-4bcf-b572-6ccbdecee317-kube-api-access-jblwj\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.714661 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.714602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13172577-97de-4bcf-b572-6ccbdecee317-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.714661 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.714637 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13172577-97de-4bcf-b572-6ccbdecee317-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.714741 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.714692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5zhq\" (UniqueName: \"kubernetes.io/projected/0c24c6ed-eb81-47fc-be86-f1cc3814ac5b-kube-api-access-g5zhq\") pod \"volume-data-source-validator-5b8776669-vwzkj\" (UID: \"0c24c6ed-eb81-47fc-be86-f1cc3814ac5b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" Jul 30 20:58:05.718345 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.718332 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.719726 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.719709 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54b496f858-sg6t2"] Jul 30 20:58:05.723547 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.723531 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 30 20:58:05.723843 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.723745 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 30 20:58:05.723843 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.723757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 30 20:58:05.724023 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.724000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mf5q2\"" Jul 30 20:58:05.724086 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.724029 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 30 20:58:05.724524 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.724500 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.728610 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.728595 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 30 20:58:05.729770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.729755 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 30 20:58:05.730234 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.730220 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 30 20:58:05.732803 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.732786 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 30 20:58:05.732803 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.732797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 30 20:58:05.733204 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.733192 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 30 20:58:05.736362 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.736349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z8ctx\"" Jul 30 20:58:05.746622 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.746604 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-tpn89"] Jul 30 20:58:05.759145 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.759107 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54b496f858-sg6t2"] Jul 30 20:58:05.761496 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.761452 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 30 20:58:05.815631 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsgx8\" (UniqueName: \"kubernetes.io/projected/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-kube-api-access-tsgx8\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.815704 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13172577-97de-4bcf-b572-6ccbdecee317-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.815704 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815683 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-serving-cert\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.815799 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815713 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5zhq\" (UniqueName: \"kubernetes.io/projected/0c24c6ed-eb81-47fc-be86-f1cc3814ac5b-kube-api-access-g5zhq\") pod \"volume-data-source-validator-5b8776669-vwzkj\" (UID: \"0c24c6ed-eb81-47fc-be86-f1cc3814ac5b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" Jul 30 20:58:05.815799 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-config\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.815929 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815908 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jblwj\" (UniqueName: \"kubernetes.io/projected/13172577-97de-4bcf-b572-6ccbdecee317-kube-api-access-jblwj\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.816064 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.815941 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.816213 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.816189 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13172577-97de-4bcf-b572-6ccbdecee317-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.816282 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.816237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.816651 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.816634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13172577-97de-4bcf-b572-6ccbdecee317-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.819357 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.819337 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/13172577-97de-4bcf-b572-6ccbdecee317-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.827715 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.827694 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jblwj\" (UniqueName: \"kubernetes.io/projected/13172577-97de-4bcf-b572-6ccbdecee317-kube-api-access-jblwj\") pod \"kube-storage-version-migrator-operator-7878f4b88c-jg46g\" (UID: \"13172577-97de-4bcf-b572-6ccbdecee317\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.828061 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.828040 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5zhq\" (UniqueName: \"kubernetes.io/projected/0c24c6ed-eb81-47fc-be86-f1cc3814ac5b-kube-api-access-g5zhq\") pod \"volume-data-source-validator-5b8776669-vwzkj\" (UID: \"0c24c6ed-eb81-47fc-be86-f1cc3814ac5b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" Jul 30 20:58:05.848803 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.848784 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" Jul 30 20:58:05.879932 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.879914 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" Jul 30 20:58:05.916955 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.916928 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-trusted-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917067 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.916973 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-serving-cert\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917067 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917033 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t84sd\" (UniqueName: \"kubernetes.io/projected/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-kube-api-access-t84sd\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.917165 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917070 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.917165 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917087 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-service-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917165 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-default-certificate\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.917304 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bxpc\" (UniqueName: \"kubernetes.io/projected/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-kube-api-access-8bxpc\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917304 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.917304 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.917415 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.917415 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917363 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-stats-auth\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:05.917415 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:05.917392 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:05.917512 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:05.917456 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:06.417436617 +0000 UTC m=+44.514662402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:05.917512 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917395 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsgx8\" (UniqueName: \"kubernetes.io/projected/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-kube-api-access-tsgx8\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.917583 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-serving-cert\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.917583 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-tmp\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917651 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917601 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-snapshots\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:05.917651 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917631 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-config\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.917757 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.917725 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:05.918273 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.918250 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-config\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.920943 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.920920 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-serving-cert\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.926157 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.925950 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsgx8\" (UniqueName: \"kubernetes.io/projected/f5aaf4aa-b2d6-46d2-92bc-068108b91d01-kube-api-access-tsgx8\") pod \"service-ca-operator-784f97bcf6-mpkmx\" (UID: \"f5aaf4aa-b2d6-46d2-92bc-068108b91d01\") " pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:05.940134 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:05.937157 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.017884 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-trusted-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.017920 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-serving-cert\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.017945 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t84sd\" (UniqueName: \"kubernetes.io/projected/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-kube-api-access-t84sd\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.017975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-service-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.017998 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-default-certificate\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018055 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bxpc\" (UniqueName: \"kubernetes.io/projected/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-kube-api-access-8bxpc\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018100 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.018136 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.018864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018181 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-stats-auth\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.018864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018246 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-tmp\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.018864 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018276 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-snapshots\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.019007 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.018966 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-snapshots\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.019090 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.019067 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-trusted-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.019169 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.019105 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:06.519087832 +0000 UTC m=+44.616313620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:06.019953 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.019359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-tmp\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.019953 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.019657 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:06.019953 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.019720 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:06.519701835 +0000 UTC m=+44.616927606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:06.019953 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.019901 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-service-ca-bundle\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.022517 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.022315 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-stats-auth\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.022517 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.022472 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-default-certificate\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.023192 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.023156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-serving-cert\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.032931 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.032735 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bxpc\" (UniqueName: \"kubernetes.io/projected/0d709fe7-5c99-4cf1-a341-ed186b3a6efe-kube-api-access-8bxpc\") pod \"insights-operator-77696685b-tpn89\" (UID: \"0d709fe7-5c99-4cf1-a341-ed186b3a6efe\") " pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.035375 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.035341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t84sd\" (UniqueName: \"kubernetes.io/projected/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-kube-api-access-t84sd\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.043382 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.043362 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj"] Jul 30 20:58:06.046974 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:06.046938 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c24c6ed_eb81_47fc_be86_f1cc3814ac5b.slice/crio-b5693d5956bcd16b9f18ad60223fd05decf4e0d6751022a071bb67e7ba7f3eee WatchSource:0}: Error finding container b5693d5956bcd16b9f18ad60223fd05decf4e0d6751022a071bb67e7ba7f3eee: Status 404 returned error can't find the container with id b5693d5956bcd16b9f18ad60223fd05decf4e0d6751022a071bb67e7ba7f3eee Jul 30 20:58:06.064735 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.064707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g"] Jul 30 20:58:06.068136 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:06.068100 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13172577_97de_4bcf_b572_6ccbdecee317.slice/crio-b5080f2124d2e60b956eb57fb8501b1677d329737cededa34d77b7657b831e67 WatchSource:0}: Error finding container b5080f2124d2e60b956eb57fb8501b1677d329737cededa34d77b7657b831e67: Status 404 returned error can't find the container with id b5080f2124d2e60b956eb57fb8501b1677d329737cededa34d77b7657b831e67 Jul 30 20:58:06.105968 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.105944 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx"] Jul 30 20:58:06.108699 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:06.108678 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5aaf4aa_b2d6_46d2_92bc_068108b91d01.slice/crio-8236f22729e749a5a8fa27364580c4f715c226d9cefc78c9be73a2aa3719abc6 WatchSource:0}: Error finding container 8236f22729e749a5a8fa27364580c4f715c226d9cefc78c9be73a2aa3719abc6: Status 404 returned error can't find the container with id 8236f22729e749a5a8fa27364580c4f715c226d9cefc78c9be73a2aa3719abc6 Jul 30 20:58:06.326822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.326768 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-tpn89" Jul 30 20:58:06.420538 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.420511 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:06.420674 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.420652 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:06.420723 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.420716 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:07.420700106 +0000 UTC m=+45.517925878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:06.466036 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.466005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-tpn89"] Jul 30 20:58:06.469362 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:06.469340 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d709fe7_5c99_4cf1_a341_ed186b3a6efe.slice/crio-e5451d49aaa7677fa23b53a9ef8fe8a5d6e1e8737920962e097690b9324d9492 WatchSource:0}: Error finding container e5451d49aaa7677fa23b53a9ef8fe8a5d6e1e8737920962e097690b9324d9492: Status 404 returned error can't find the container with id e5451d49aaa7677fa23b53a9ef8fe8a5d6e1e8737920962e097690b9324d9492 Jul 30 20:58:06.521628 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.521606 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.521712 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.521632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:06.521804 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.521788 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:07.521773476 +0000 UTC m=+45.618999247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:06.521889 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.521873 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:06.521938 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:06.521927 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:07.521914959 +0000 UTC m=+45.619140730 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:06.612128 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.612036 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" event={"ID":"0c24c6ed-eb81-47fc-be86-f1cc3814ac5b","Type":"ContainerStarted","Data":"b5693d5956bcd16b9f18ad60223fd05decf4e0d6751022a071bb67e7ba7f3eee"} Jul 30 20:58:06.613585 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.613544 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" event={"ID":"f5aaf4aa-b2d6-46d2-92bc-068108b91d01","Type":"ContainerStarted","Data":"8236f22729e749a5a8fa27364580c4f715c226d9cefc78c9be73a2aa3719abc6"} Jul 30 20:58:06.615572 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.615543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-tpn89" event={"ID":"0d709fe7-5c99-4cf1-a341-ed186b3a6efe","Type":"ContainerStarted","Data":"e5451d49aaa7677fa23b53a9ef8fe8a5d6e1e8737920962e097690b9324d9492"} Jul 30 20:58:06.619588 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:06.619541 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" event={"ID":"13172577-97de-4bcf-b572-6ccbdecee317","Type":"ContainerStarted","Data":"b5080f2124d2e60b956eb57fb8501b1677d329737cededa34d77b7657b831e67"} Jul 30 20:58:07.428293 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:07.428253 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:07.428799 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:07.428411 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:07.428799 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:07.428480 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:09.428466451 +0000 UTC m=+47.525692221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:07.529256 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:07.529229 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:07.529427 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:07.529270 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:07.529427 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:07.529420 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:09.529398996 +0000 UTC m=+47.626624771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:07.529576 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:07.529444 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:07.529576 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:07.529491 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:09.529475917 +0000 UTC m=+47.626701690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:08.626972 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:08.626934 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" event={"ID":"0c24c6ed-eb81-47fc-be86-f1cc3814ac5b","Type":"ContainerStarted","Data":"44be419d728d8edcfc943c59df05210d8b6fc6771c0f0f7ce24eae817c629b16"} Jul 30 20:58:08.644472 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:08.644410 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5b8776669-vwzkj" podStartSLOduration=2.176022153 podStartE2EDuration="3.644390804s" totalImagesPullingTime="1.468368651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:08.642947164 +0000 UTC m=+46.740172978" watchObservedRunningTime="2026-07-30 20:58:08.644390804 +0000 UTC m=+46.741616598" Jul 30 20:58:09.441060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:09.441024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:09.441258 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:09.441204 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:09.441314 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:09.441282 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:13.441259488 +0000 UTC m=+51.538485262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:09.541736 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:09.541696 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:09.541736 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:09.541729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:09.541906 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:09.541852 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:13.541835459 +0000 UTC m=+51.639061230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:09.541906 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:09.541854 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:09.541906 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:09.541887 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:13.541881178 +0000 UTC m=+51.639106948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:10.634873 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.634836 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" event={"ID":"f5aaf4aa-b2d6-46d2-92bc-068108b91d01","Type":"ContainerStarted","Data":"6aa174b021536dac70612b4c936a78df407d5cde15a9f181063e1ec934286635"} Jul 30 20:58:10.636593 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.636571 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-tpn89" event={"ID":"0d709fe7-5c99-4cf1-a341-ed186b3a6efe","Type":"ContainerStarted","Data":"26e1bf2f213ac82b513d9d02597350a291e2383d1a92f13a0eba5ac391e99e61"} Jul 30 20:58:10.638060 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.638038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" event={"ID":"13172577-97de-4bcf-b572-6ccbdecee317","Type":"ContainerStarted","Data":"6345c7807f1b482e696dece3c5b4591dd1720786c22c8478073ebd5bceb26003"} Jul 30 20:58:10.653264 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.653219 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" podStartSLOduration=1.729797953 podStartE2EDuration="5.653202985s" totalImagesPullingTime="3.923405032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:10.652832597 +0000 UTC m=+48.750058385" watchObservedRunningTime="2026-07-30 20:58:10.653202985 +0000 UTC m=+48.750428779" Jul 30 20:58:10.668714 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.668671 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" podStartSLOduration=1.705233895 podStartE2EDuration="5.668653737s" totalImagesPullingTime="3.963419842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:10.667821725 +0000 UTC m=+48.765047520" watchObservedRunningTime="2026-07-30 20:58:10.668653737 +0000 UTC m=+48.765879529" Jul 30 20:58:10.686387 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.686344 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-tpn89" podStartSLOduration=2.118887147 podStartE2EDuration="5.686327203s" totalImagesPullingTime="3.567440056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:10.685641546 +0000 UTC m=+48.782867360" watchObservedRunningTime="2026-07-30 20:58:10.686327203 +0000 UTC m=+48.783552992" Jul 30 20:58:10.817240 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.817207 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hrsfw"] Jul 30 20:58:10.838610 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.838581 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrsfw"] Jul 30 20:58:10.838731 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.838713 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.841424 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.841406 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 30 20:58:10.841643 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.841423 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 30 20:58:10.841759 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.841547 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ws5tw\"" Jul 30 20:58:10.852559 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.852534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45a25b74-5b9a-4abf-87bb-50660e29c37d-crio-socket\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.852657 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.852566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.852657 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.852585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vfv\" (UniqueName: \"kubernetes.io/projected/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-api-access-67vfv\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.852749 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.852662 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45a25b74-5b9a-4abf-87bb-50660e29c37d-data-volume\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.852749 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.852704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953464 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953400 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45a25b74-5b9a-4abf-87bb-50660e29c37d-data-volume\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953464 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953449 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953636 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45a25b74-5b9a-4abf-87bb-50660e29c37d-crio-socket\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953636 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953636 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vfv\" (UniqueName: \"kubernetes.io/projected/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-api-access-67vfv\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:10.953633 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:10.953658 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:10.953691 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:11.453674486 +0000 UTC m=+49.550900261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:10.953715 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:11.453697825 +0000 UTC m=+49.550923599 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : configmap "kube-rbac-proxy" not found Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/45a25b74-5b9a-4abf-87bb-50660e29c37d-crio-socket\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.953787 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.953770 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/45a25b74-5b9a-4abf-87bb-50660e29c37d-data-volume\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:10.961896 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:10.961860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vfv\" (UniqueName: \"kubernetes.io/projected/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-api-access-67vfv\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:11.457589 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:11.457558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:11.457739 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:11.457632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:11.457739 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:11.457689 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 20:58:11.457817 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:11.457754 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:12.457739195 +0000 UTC m=+50.554964978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : configmap "kube-rbac-proxy" not found Jul 30 20:58:11.457817 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:11.457793 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:11.457886 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:11.457858 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:12.457840384 +0000 UTC m=+50.555066171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:12.465803 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:12.465771 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:12.466163 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:12.465832 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:12.466163 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:12.465887 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 20:58:12.466163 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:12.465917 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:12.466163 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:12.465961 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:14.465943114 +0000 UTC m=+52.563168886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : configmap "kube-rbac-proxy" not found Jul 30 20:58:12.466163 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:12.465976 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:14.465969187 +0000 UTC m=+52.563194958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:12.767533 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:12.767506 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lms86_28e33746-93cc-4ca7-890a-c836fd0a1a2e/dns-node-resolver/0.log" Jul 30 20:58:13.071026 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:13.070965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:13.071167 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.071127 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 30 20:58:13.071214 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.071186 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls podName:ec285956-ca90-42d9-b8e0-3d519ffa7ed4 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:29.07117133 +0000 UTC m=+67.168397103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls") pod "dns-default-hdj8x" (UID: "ec285956-ca90-42d9-b8e0-3d519ffa7ed4") : secret "dns-default-metrics-tls" not found Jul 30 20:58:13.473928 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:13.473839 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:13.474328 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.473956 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:13.474328 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.474016 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:21.474001472 +0000 UTC m=+59.571227243 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:13.567042 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:13.567016 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n564_ca185b72-0eac-4af2-aec0-3bed6a3179d9/node-ca/0.log" Jul 30 20:58:13.574330 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:13.574304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:13.574447 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.574437 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:13.574512 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:13.574457 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:13.574512 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.574483 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:21.574468921 +0000 UTC m=+59.671694693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:13.574612 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:13.574562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:21.574545235 +0000 UTC m=+59.671771008 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:14.481585 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:14.481551 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:14.481946 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:14.481659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:14.481946 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:14.481710 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:14.481946 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:14.481773 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:18.481756559 +0000 UTC m=+56.578982342 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:14.481946 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:14.481774 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 20:58:14.481946 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:14.481835 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:18.481819276 +0000 UTC m=+56.579045047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : configmap "kube-rbac-proxy" not found Jul 30 20:58:14.767275 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:14.767250 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6th8_d4999865-691c-47a9-b861-11d7f8e0544f/serve-healthcheck-canary/0.log" Jul 30 20:58:18.509802 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:18.509748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:18.510349 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:18.509862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:18.510349 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:18.509896 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 30 20:58:18.510349 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:18.509973 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:26.509954769 +0000 UTC m=+64.607180540 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : configmap "kube-rbac-proxy" not found Jul 30 20:58:18.510349 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:18.510014 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:18.510349 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:18.510070 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:26.510056535 +0000 UTC m=+64.607282307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:21.534216 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:21.534186 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:21.534661 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:21.534370 2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 30 20:58:21.534661 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:21.534449 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert podName:01e275f3-ed95-44c4-b0e7-f62b8c6b170c nodeName:}" failed. No retries permitted until 2026-07-30 20:58:37.534426571 +0000 UTC m=+75.631652344 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-ntjch" (UID: "01e275f3-ed95-44c4-b0e7-f62b8c6b170c") : secret "networking-console-plugin-cert" not found Jul 30 20:58:21.573875 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:21.573851 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6xq5" Jul 30 20:58:21.634834 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:21.634802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:21.634960 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:21.634894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:21.635037 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:21.635011 2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 30 20:58:21.635160 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:21.635145 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:37.635108139 +0000 UTC m=+75.732333923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : secret "router-metrics-certs-default" not found Jul 30 20:58:21.635264 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:21.635171 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle podName:3a4b724f-e7ba-409c-bf4f-7d193d68d43e nodeName:}" failed. No retries permitted until 2026-07-30 20:58:37.635160292 +0000 UTC m=+75.732386068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle") pod "router-default-54b496f858-sg6t2" (UID: "3a4b724f-e7ba-409c-bf4f-7d193d68d43e") : configmap references non-existent config key: service-ca.crt Jul 30 20:58:26.573627 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:26.573593 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:26.573987 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:26.573680 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:26.573987 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:26.573762 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 30 20:58:26.573987 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:26.573828 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls podName:45a25b74-5b9a-4abf-87bb-50660e29c37d nodeName:}" failed. No retries permitted until 2026-07-30 20:58:42.573812902 +0000 UTC m=+80.671038674 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hrsfw" (UID: "45a25b74-5b9a-4abf-87bb-50660e29c37d") : secret "insights-runtime-extractor-tls" not found Jul 30 20:58:26.574167 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:26.574152 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/45a25b74-5b9a-4abf-87bb-50660e29c37d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:28.082668 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.082634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:58:28.083022 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.082684 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:58:28.085651 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.085629 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 30 20:58:28.086691 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.086675 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 30 20:58:28.095204 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.095181 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 30 20:58:28.095299 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.095219 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57-metrics-certs\") pod \"network-metrics-daemon-ggzpn\" (UID: \"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57\") " pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:58:28.105441 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.105421 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcwrm\" (UniqueName: \"kubernetes.io/projected/2ebfc622-bde7-4296-ac4a-1951568e9855-kube-api-access-kcwrm\") pod \"network-check-target-ftb44\" (UID: \"2ebfc622-bde7-4296-ac4a-1951568e9855\") " pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:58:28.121890 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.121873 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xh5pq\"" Jul 30 20:58:28.125877 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.125862 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-66vkk\"" Jul 30 20:58:28.129971 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.129958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggzpn" Jul 30 20:58:28.134636 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.134624 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:58:28.184155 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.184102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:58:28.187731 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.187703 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 30 20:58:28.196854 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.196823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ef8ae32e-73f5-4f4b-9cdb-f641607576b8-original-pull-secret\") pod \"global-pull-secret-syncer-mm8qr\" (UID: \"ef8ae32e-73f5-4f4b-9cdb-f641607576b8\") " pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:58:28.262422 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.262395 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggzpn"] Jul 30 20:58:28.265134 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:28.265098 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d6bcc2_c5b5_4236_b6ea_ba542ab12b57.slice/crio-cc1012fddd38b7d61c8e17469f1687d266a7b4da9b75cd499e62821bac2e3bdb WatchSource:0}: Error finding container cc1012fddd38b7d61c8e17469f1687d266a7b4da9b75cd499e62821bac2e3bdb: Status 404 returned error can't find the container with id cc1012fddd38b7d61c8e17469f1687d266a7b4da9b75cd499e62821bac2e3bdb Jul 30 20:58:28.276093 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.276003 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ftb44"] Jul 30 20:58:28.278287 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:28.278265 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebfc622_bde7_4296_ac4a_1951568e9855.slice/crio-d069f56952747ec12ffed7e672e7e7f5a250fa53e94ea608e24817647dff75c2 WatchSource:0}: Error finding container d069f56952747ec12ffed7e672e7e7f5a250fa53e94ea608e24817647dff75c2: Status 404 returned error can't find the container with id d069f56952747ec12ffed7e672e7e7f5a250fa53e94ea608e24817647dff75c2 Jul 30 20:58:28.413653 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.413600 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mm8qr" Jul 30 20:58:28.532608 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.532574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mm8qr"] Jul 30 20:58:28.535172 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:28.535147 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8ae32e_73f5_4f4b_9cdb_f641607576b8.slice/crio-1acc4f9491327b1f8d4168c944f01ffbba611bf91d266152a48736209e36bf4b WatchSource:0}: Error finding container 1acc4f9491327b1f8d4168c944f01ffbba611bf91d266152a48736209e36bf4b: Status 404 returned error can't find the container with id 1acc4f9491327b1f8d4168c944f01ffbba611bf91d266152a48736209e36bf4b Jul 30 20:58:28.693672 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.693605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mm8qr" event={"ID":"ef8ae32e-73f5-4f4b-9cdb-f641607576b8","Type":"ContainerStarted","Data":"1acc4f9491327b1f8d4168c944f01ffbba611bf91d266152a48736209e36bf4b"} Jul 30 20:58:28.694664 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.694638 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftb44" event={"ID":"2ebfc622-bde7-4296-ac4a-1951568e9855","Type":"ContainerStarted","Data":"d069f56952747ec12ffed7e672e7e7f5a250fa53e94ea608e24817647dff75c2"} Jul 30 20:58:28.695687 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:28.695670 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggzpn" event={"ID":"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57","Type":"ContainerStarted","Data":"cc1012fddd38b7d61c8e17469f1687d266a7b4da9b75cd499e62821bac2e3bdb"} Jul 30 20:58:29.092188 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:29.092152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:29.094961 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:29.094935 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec285956-ca90-42d9-b8e0-3d519ffa7ed4-metrics-tls\") pod \"dns-default-hdj8x\" (UID: \"ec285956-ca90-42d9-b8e0-3d519ffa7ed4\") " pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:29.356353 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:29.356280 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-77cz9\"" Jul 30 20:58:29.364634 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:29.364608 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:29.798527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:29.798490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hdj8x"] Jul 30 20:58:29.801910 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:29.801879 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec285956_ca90_42d9_b8e0_3d519ffa7ed4.slice/crio-af646a89c6b982028cf2b6550d0569731c67e5efc6b48c172d9226ec350d85ce WatchSource:0}: Error finding container af646a89c6b982028cf2b6550d0569731c67e5efc6b48c172d9226ec350d85ce: Status 404 returned error can't find the container with id af646a89c6b982028cf2b6550d0569731c67e5efc6b48c172d9226ec350d85ce Jul 30 20:58:30.705588 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:30.705463 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdj8x" event={"ID":"ec285956-ca90-42d9-b8e0-3d519ffa7ed4","Type":"ContainerStarted","Data":"af646a89c6b982028cf2b6550d0569731c67e5efc6b48c172d9226ec350d85ce"} Jul 30 20:58:30.709958 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:30.709166 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggzpn" event={"ID":"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57","Type":"ContainerStarted","Data":"5f7e8ae1ce94f00cc24c80c93809d9d4bf1bb517f75afe2420568408fbe5f593"} Jul 30 20:58:30.709958 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:30.709219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggzpn" event={"ID":"d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57","Type":"ContainerStarted","Data":"295e626f9fa7a71d18566f7890ad34f4bd291ef7282b3f1aee3de2eb4b018393"} Jul 30 20:58:30.726527 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:30.726221 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggzpn" podStartSLOduration=66.985325501 podStartE2EDuration="1m8.726180852s" totalImagesPullingTime="1.740855351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:30.725603552 +0000 UTC m=+68.822829368" watchObservedRunningTime="2026-07-30 20:58:30.726180852 +0000 UTC m=+68.823406649" Jul 30 20:58:33.720846 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.720771 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mm8qr" event={"ID":"ef8ae32e-73f5-4f4b-9cdb-f641607576b8","Type":"ContainerStarted","Data":"e916b0310788fc6fb14fa14ae85de5cf0bbdcdf481e766e2656a2f88fd18c33d"} Jul 30 20:58:33.722262 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.722235 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ftb44" event={"ID":"2ebfc622-bde7-4296-ac4a-1951568e9855","Type":"ContainerStarted","Data":"5bca40c947e10594a255f739491bb9cec202842805e9621e37b68fe7e77b1d5b"} Jul 30 20:58:33.722390 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.722292 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:58:33.723831 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.723809 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdj8x" event={"ID":"ec285956-ca90-42d9-b8e0-3d519ffa7ed4","Type":"ContainerStarted","Data":"5dae006358aa30c217944a9fb04e7a8541ee9f6caf7584b94cf4c4c38e52fb8e"} Jul 30 20:58:33.723898 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.723876 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hdj8x" event={"ID":"ec285956-ca90-42d9-b8e0-3d519ffa7ed4","Type":"ContainerStarted","Data":"1f3805e53cbd5d55a8188692bed28a02d96a5611048c4a5891d71d8f031d2ad6"} Jul 30 20:58:33.723940 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.723908 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:33.735645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.735604 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mm8qr" podStartSLOduration=66.851590864 podStartE2EDuration="1m11.735591686s" totalImagesPullingTime="4.884000822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:33.734757386 +0000 UTC m=+71.831983198" watchObservedRunningTime="2026-07-30 20:58:33.735591686 +0000 UTC m=+71.832817479" Jul 30 20:58:33.748959 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.748920 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ftb44" podStartSLOduration=66.622184944 podStartE2EDuration="1m11.748908029s" totalImagesPullingTime="5.126723085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:33.748691577 +0000 UTC m=+71.845917397" watchObservedRunningTime="2026-07-30 20:58:33.748908029 +0000 UTC m=+71.846133821" Jul 30 20:58:33.765942 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:33.765901 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hdj8x" podStartSLOduration=33.157900916 podStartE2EDuration="36.765889599s" totalImagesPullingTime="3.607988683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:33.764831639 +0000 UTC m=+71.862057431" watchObservedRunningTime="2026-07-30 20:58:33.765889599 +0000 UTC m=+71.863115391" Jul 30 20:58:34.744911 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.744880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5964d6864-77nk9"] Jul 30 20:58:34.746872 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.746852 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.749412 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.749394 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 30 20:58:34.749801 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.749778 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 30 20:58:34.750652 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.750635 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 30 20:58:34.750652 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.750641 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-klzqk\"" Jul 30 20:58:34.756763 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.756741 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 30 20:58:34.765754 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.765732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5964d6864-77nk9"] Jul 30 20:58:34.835773 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835746 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-installation-pull-secrets\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.835866 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k2mz\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-kube-api-access-6k2mz\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.835866 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-certificates\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.835941 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835892 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-tls\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.835941 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a1cf560-39a1-426f-8d98-f4890ee3bee9-ca-trust-extracted\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.836024 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835966 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-image-registry-private-configuration\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.836024 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.835989 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-trusted-ca\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.836153 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.836129 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-bound-sa-token\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937256 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-certificates\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-tls\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937279 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a1cf560-39a1-426f-8d98-f4890ee3bee9-ca-trust-extracted\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-image-registry-private-configuration\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937354 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937322 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-trusted-ca\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937507 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-bound-sa-token\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937507 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-installation-pull-secrets\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937598 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937536 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k2mz\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-kube-api-access-6k2mz\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.937944 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.937923 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4a1cf560-39a1-426f-8d98-f4890ee3bee9-ca-trust-extracted\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.938109 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.938084 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-certificates\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.938621 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.938600 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4a1cf560-39a1-426f-8d98-f4890ee3bee9-trusted-ca\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.939878 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.939855 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-registry-tls\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.939950 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.939913 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-installation-pull-secrets\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.939950 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.939917 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4a1cf560-39a1-426f-8d98-f4890ee3bee9-image-registry-private-configuration\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.948573 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.948548 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k2mz\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-kube-api-access-6k2mz\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:34.951524 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:34.951504 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a1cf560-39a1-426f-8d98-f4890ee3bee9-bound-sa-token\") pod \"image-registry-5964d6864-77nk9\" (UID: \"4a1cf560-39a1-426f-8d98-f4890ee3bee9\") " pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:35.059920 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.059867 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:35.183654 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.183627 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5964d6864-77nk9"] Jul 30 20:58:35.187025 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:35.187001 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1cf560_39a1_426f_8d98_f4890ee3bee9.slice/crio-bb1ab6db723ac2b15aa5c02a8b0455b981aae004418534ad185e4669d55ecc60 WatchSource:0}: Error finding container bb1ab6db723ac2b15aa5c02a8b0455b981aae004418534ad185e4669d55ecc60: Status 404 returned error can't find the container with id bb1ab6db723ac2b15aa5c02a8b0455b981aae004418534ad185e4669d55ecc60 Jul 30 20:58:35.731933 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.731897 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5964d6864-77nk9" event={"ID":"4a1cf560-39a1-426f-8d98-f4890ee3bee9","Type":"ContainerStarted","Data":"86c483dfd6f784adc1214b317fdb0a87f8fbc4649778389b94f4eb157a7b024b"} Jul 30 20:58:35.732128 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.731947 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5964d6864-77nk9" event={"ID":"4a1cf560-39a1-426f-8d98-f4890ee3bee9","Type":"ContainerStarted","Data":"bb1ab6db723ac2b15aa5c02a8b0455b981aae004418534ad185e4669d55ecc60"} Jul 30 20:58:35.732128 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.732042 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:35.752237 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:35.752194 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5964d6864-77nk9" podStartSLOduration=1.752180546 podStartE2EDuration="1.752180546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:35.751480715 +0000 UTC m=+73.848706513" watchObservedRunningTime="2026-07-30 20:58:35.752180546 +0000 UTC m=+73.849406339" Jul 30 20:58:37.557039 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.557006 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:37.559286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.559268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01e275f3-ed95-44c4-b0e7-f62b8c6b170c-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-ntjch\" (UID: \"01e275f3-ed95-44c4-b0e7-f62b8c6b170c\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:37.657958 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.657933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:37.658067 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.657976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:37.658535 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.658516 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-service-ca-bundle\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:37.660037 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.660013 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a4b724f-e7ba-409c-bf4f-7d193d68d43e-metrics-certs\") pod \"router-default-54b496f858-sg6t2\" (UID: \"3a4b724f-e7ba-409c-bf4f-7d193d68d43e\") " pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:37.752300 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.752283 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-brv4d\"" Jul 30 20:58:37.760512 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.760491 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" Jul 30 20:58:37.835278 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.835254 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-z8ctx\"" Jul 30 20:58:37.843502 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.843478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:37.881052 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.880932 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-ntjch"] Jul 30 20:58:37.883909 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:37.883882 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01e275f3_ed95_44c4_b0e7_f62b8c6b170c.slice/crio-0d0e598305e4553e3b4f449b6751cadb3bb6ee3f9935174cd32491f23f445ff0 WatchSource:0}: Error finding container 0d0e598305e4553e3b4f449b6751cadb3bb6ee3f9935174cd32491f23f445ff0: Status 404 returned error can't find the container with id 0d0e598305e4553e3b4f449b6751cadb3bb6ee3f9935174cd32491f23f445ff0 Jul 30 20:58:37.973564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:37.973544 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54b496f858-sg6t2"] Jul 30 20:58:37.975557 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:37.975537 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a4b724f_e7ba_409c_bf4f_7d193d68d43e.slice/crio-db087c9df7a73ccf4a7892a4fd3195ec9b9e783bcf9eabb3287121f855312a98 WatchSource:0}: Error finding container db087c9df7a73ccf4a7892a4fd3195ec9b9e783bcf9eabb3287121f855312a98: Status 404 returned error can't find the container with id db087c9df7a73ccf4a7892a4fd3195ec9b9e783bcf9eabb3287121f855312a98 Jul 30 20:58:38.744642 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.744601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54b496f858-sg6t2" event={"ID":"3a4b724f-e7ba-409c-bf4f-7d193d68d43e","Type":"ContainerStarted","Data":"8af7049cef60adaf2c04b300ecf862d601f388d20e60d2e6b97baffe96d1452b"} Jul 30 20:58:38.745071 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.744657 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54b496f858-sg6t2" event={"ID":"3a4b724f-e7ba-409c-bf4f-7d193d68d43e","Type":"ContainerStarted","Data":"db087c9df7a73ccf4a7892a4fd3195ec9b9e783bcf9eabb3287121f855312a98"} Jul 30 20:58:38.745810 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.745780 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" event={"ID":"01e275f3-ed95-44c4-b0e7-f62b8c6b170c","Type":"ContainerStarted","Data":"0d0e598305e4553e3b4f449b6751cadb3bb6ee3f9935174cd32491f23f445ff0"} Jul 30 20:58:38.765121 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.765069 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54b496f858-sg6t2" podStartSLOduration=33.765055895 podStartE2EDuration="33.765055895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:38.764359598 +0000 UTC m=+76.861585419" watchObservedRunningTime="2026-07-30 20:58:38.765055895 +0000 UTC m=+76.862281687" Jul 30 20:58:38.844688 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.844662 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:38.847255 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:38.847236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:39.750648 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:39.750607 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" event={"ID":"01e275f3-ed95-44c4-b0e7-f62b8c6b170c","Type":"ContainerStarted","Data":"b1ef927a4aedde45ff756efa274a68a2d5607dd22b09c41ff5ae9b97cfc3e955"} Jul 30 20:58:39.751084 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:39.750791 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:39.752526 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:39.752505 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54b496f858-sg6t2" Jul 30 20:58:39.770612 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:39.770571 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-ntjch" podStartSLOduration=33.415238964 podStartE2EDuration="34.770559017s" totalImagesPullingTime="1.355320053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:39.769234719 +0000 UTC m=+77.866460512" watchObservedRunningTime="2026-07-30 20:58:39.770559017 +0000 UTC m=+77.867784810" Jul 30 20:58:40.007039 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.006968 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd"] Jul 30 20:58:40.009780 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.009764 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:40.012639 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.012609 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 30 20:58:40.012769 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.012707 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n9msf\"" Jul 30 20:58:40.017884 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.017864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd"] Jul 30 20:58:40.078409 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.078387 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe0125f7-3398-4589-a1d9-e8cd30079184-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zpnqd\" (UID: \"fe0125f7-3398-4589-a1d9-e8cd30079184\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:40.179670 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.179640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe0125f7-3398-4589-a1d9-e8cd30079184-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zpnqd\" (UID: \"fe0125f7-3398-4589-a1d9-e8cd30079184\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:40.181933 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.181910 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/fe0125f7-3398-4589-a1d9-e8cd30079184-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-zpnqd\" (UID: \"fe0125f7-3398-4589-a1d9-e8cd30079184\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:40.318051 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.318002 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:40.437719 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.437689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd"] Jul 30 20:58:40.440142 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:40.440103 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0125f7_3398_4589_a1d9_e8cd30079184.slice/crio-5c7def4f17920c7d663b8f074fdc833f456b059ecf6e995157d23523a96056e8 WatchSource:0}: Error finding container 5c7def4f17920c7d663b8f074fdc833f456b059ecf6e995157d23523a96056e8: Status 404 returned error can't find the container with id 5c7def4f17920c7d663b8f074fdc833f456b059ecf6e995157d23523a96056e8 Jul 30 20:58:40.754781 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:40.754747 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" event={"ID":"fe0125f7-3398-4589-a1d9-e8cd30079184","Type":"ContainerStarted","Data":"5c7def4f17920c7d663b8f074fdc833f456b059ecf6e995157d23523a96056e8"} Jul 30 20:58:41.759466 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:41.759436 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" event={"ID":"fe0125f7-3398-4589-a1d9-e8cd30079184","Type":"ContainerStarted","Data":"4323bce5a2a60e10487232ceef557c5b28c7e41c02a4d77b131fca3aacc7289c"} Jul 30 20:58:41.759860 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:41.759624 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:41.764170 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:41.764149 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" Jul 30 20:58:41.774984 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:41.774828 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-zpnqd" podStartSLOduration=1.666960475 podStartE2EDuration="2.774814998s" totalImagesPullingTime="1.107854523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:41.774677121 +0000 UTC m=+79.871902913" watchObservedRunningTime="2026-07-30 20:58:41.774814998 +0000 UTC m=+79.872040804" Jul 30 20:58:42.593235 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:42.593205 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:42.595414 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:42.595396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/45a25b74-5b9a-4abf-87bb-50660e29c37d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hrsfw\" (UID: \"45a25b74-5b9a-4abf-87bb-50660e29c37d\") " pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:42.650643 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:42.650618 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ws5tw\"" Jul 30 20:58:42.658772 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:42.658755 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hrsfw" Jul 30 20:58:42.815889 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:42.815863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hrsfw"] Jul 30 20:58:42.818167 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:42.818142 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a25b74_5b9a_4abf_87bb_50660e29c37d.slice/crio-dc52a4df9e888765b668cf1f9d092f7283bc8c62d68853f2c319093ed8712cc9 WatchSource:0}: Error finding container dc52a4df9e888765b668cf1f9d092f7283bc8c62d68853f2c319093ed8712cc9: Status 404 returned error can't find the container with id dc52a4df9e888765b668cf1f9d092f7283bc8c62d68853f2c319093ed8712cc9 Jul 30 20:58:43.730039 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:43.729945 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hdj8x" Jul 30 20:58:43.768277 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:43.768245 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrsfw" event={"ID":"45a25b74-5b9a-4abf-87bb-50660e29c37d","Type":"ContainerStarted","Data":"71f51701198c7a19d9c7fc1bbe0845e653e695abd5806b3043ff1f004e0f1b38"} Jul 30 20:58:43.768414 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:43.768293 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrsfw" event={"ID":"45a25b74-5b9a-4abf-87bb-50660e29c37d","Type":"ContainerStarted","Data":"dc52a4df9e888765b668cf1f9d092f7283bc8c62d68853f2c319093ed8712cc9"} Jul 30 20:58:44.774362 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:44.774324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrsfw" event={"ID":"45a25b74-5b9a-4abf-87bb-50660e29c37d","Type":"ContainerStarted","Data":"4b9967be596fd4b81dcbd97f9d0d513a722ca1f83afdea0e89dca272ef9f374b"} Jul 30 20:58:45.779958 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:45.779925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hrsfw" event={"ID":"45a25b74-5b9a-4abf-87bb-50660e29c37d","Type":"ContainerStarted","Data":"d0570c0b6e5b99e758b0e4ce976eb44188e369417c031e1a67d0c80efcde3c66"} Jul 30 20:58:45.801430 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:45.801387 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hrsfw" podStartSLOduration=33.482958266 podStartE2EDuration="35.801373948s" totalImagesPullingTime="2.318415682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 20:58:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:45.799610525 +0000 UTC m=+83.896836317" watchObservedRunningTime="2026-07-30 20:58:45.801373948 +0000 UTC m=+83.898599742" Jul 30 20:58:46.420845 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.420810 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s"] Jul 30 20:58:46.422997 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.422976 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.426087 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.426061 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 30 20:58:46.426087 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.426065 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 30 20:58:46.426331 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.426098 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 30 20:58:46.426331 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.426109 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 30 20:58:46.427253 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.427235 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sr4z8\"" Jul 30 20:58:46.427340 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.427292 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 30 20:58:46.445054 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.445036 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s"] Jul 30 20:58:46.493054 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.493031 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gfhnv"] Jul 30 20:58:46.495264 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.495248 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.498023 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.498006 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 30 20:58:46.498247 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.498231 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 30 20:58:46.498328 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.498239 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6shkw\"" Jul 30 20:58:46.498851 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.498834 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 30 20:58:46.523832 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.523812 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrgng\" (UniqueName: \"kubernetes.io/projected/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-kube-api-access-qrgng\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.523928 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.523870 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.523991 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.523923 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.523991 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.523960 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.624832 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpglq\" (UniqueName: \"kubernetes.io/projected/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-kube-api-access-rpglq\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.624917 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.624917 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624854 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-textfile\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.624917 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624869 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-accelerators-collector-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-sys\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.624960 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.625015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.625108 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625046 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.625108 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625200 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-root\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625200 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625157 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-wtmp\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625325 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrgng\" (UniqueName: \"kubernetes.io/projected/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-kube-api-access-qrgng\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.625325 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625284 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-metrics-client-ca\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.625658 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.625634 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.627372 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.627347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.627456 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.627377 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.634056 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.634036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrgng\" (UniqueName: \"kubernetes.io/projected/684cb8ca-cdc3-4bc9-9125-dfe901a850ad-kube-api-access-qrgng\") pod \"openshift-state-metrics-6bb4d7b4dd-4lz9s\" (UID: \"684cb8ca-cdc3-4bc9-9125-dfe901a850ad\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.726323 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-metrics-client-ca\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726323 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpglq\" (UniqueName: \"kubernetes.io/projected/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-kube-api-access-rpglq\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726451 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726332 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726451 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726349 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-textfile\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726451 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-accelerators-collector-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726451 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:46.726431 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 30 20:58:46.726591 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:46.726489 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls podName:30c8925e-a3ed-49ab-b7d4-95f6ba98e314 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:47.226470952 +0000 UTC m=+85.323696728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls") pod "node-exporter-gfhnv" (UID: "30c8925e-a3ed-49ab-b7d4-95f6ba98e314") : secret "node-exporter-tls" not found Jul 30 20:58:46.726591 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-sys\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726591 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726558 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726707 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726615 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-sys\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726707 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726648 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-root\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726707 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-textfile\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726707 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-wtmp\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726854 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726722 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-root\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726854 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726834 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-wtmp\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726912 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726862 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-metrics-client-ca\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.726945 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.726914 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-accelerators-collector-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.728509 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.728488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.731601 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.731587 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" Jul 30 20:58:46.735393 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.735372 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpglq\" (UniqueName: \"kubernetes.io/projected/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-kube-api-access-rpglq\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:46.856324 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:46.856302 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s"] Jul 30 20:58:46.858816 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:46.858789 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684cb8ca_cdc3_4bc9_9125_dfe901a850ad.slice/crio-80f078c50c6e6c2259fee4988ca9af28aa5f378ff2a9b769a06d49bde78e5e6e WatchSource:0}: Error finding container 80f078c50c6e6c2259fee4988ca9af28aa5f378ff2a9b769a06d49bde78e5e6e: Status 404 returned error can't find the container with id 80f078c50c6e6c2259fee4988ca9af28aa5f378ff2a9b769a06d49bde78e5e6e Jul 30 20:58:47.232220 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.232188 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:47.234398 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.234375 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/30c8925e-a3ed-49ab-b7d4-95f6ba98e314-node-exporter-tls\") pod \"node-exporter-gfhnv\" (UID: \"30c8925e-a3ed-49ab-b7d4-95f6ba98e314\") " pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:47.403641 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.403614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gfhnv" Jul 30 20:58:47.412290 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:47.412267 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c8925e_a3ed_49ab_b7d4_95f6ba98e314.slice/crio-ae4d050b6ab317f034be3f1e8e8aa892b99794f80d16bc94e14e9430bb93be6a WatchSource:0}: Error finding container ae4d050b6ab317f034be3f1e8e8aa892b99794f80d16bc94e14e9430bb93be6a: Status 404 returned error can't find the container with id ae4d050b6ab317f034be3f1e8e8aa892b99794f80d16bc94e14e9430bb93be6a Jul 30 20:58:47.510386 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.510359 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 20:58:47.515532 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.513622 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.516708 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.516667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 30 20:58:47.516708 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.516667 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 30 20:58:47.516995 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.516981 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 30 20:58:47.517070 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.516978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 30 20:58:47.517070 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517030 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 30 20:58:47.517468 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517453 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xsv2\"" Jul 30 20:58:47.517564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517474 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 30 20:58:47.517564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517505 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 30 20:58:47.517705 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517693 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 30 20:58:47.517998 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.517985 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 30 20:58:47.529429 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.529410 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 20:58:47.634844 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.634957 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634852 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.634957 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634871 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.634957 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634888 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.634957 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.634983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635013 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6bl6\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635145 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635169 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.635209 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.635184 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736334 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736302 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6bl6\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736477 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736341 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736477 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736477 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736379 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736630 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736746 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:47.736655 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle podName:04a397cc-2196-451f-a6c7-13895a10c505 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:48.236627271 +0000 UTC m=+86.333853046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "04a397cc-2196-451f-a6c7-13895a10c505") : configmap references non-existent config key: ca-bundle.crt Jul 30 20:58:47.736746 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736674 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736746 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736699 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736746 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736954 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736763 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736954 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736954 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736822 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.736954 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.736869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.737204 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.737183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.737860 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.737835 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.740230 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.740183 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.740347 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.740328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.740719 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.740700 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.741063 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.741037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.741177 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.741099 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.741628 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.741607 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.742018 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.741999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.742100 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.742050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.743044 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.743024 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.745606 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.745586 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6bl6\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:47.789574 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.789515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gfhnv" event={"ID":"30c8925e-a3ed-49ab-b7d4-95f6ba98e314","Type":"ContainerStarted","Data":"ae4d050b6ab317f034be3f1e8e8aa892b99794f80d16bc94e14e9430bb93be6a"} Jul 30 20:58:47.791751 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.791726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" event={"ID":"684cb8ca-cdc3-4bc9-9125-dfe901a850ad","Type":"ContainerStarted","Data":"b248daa81acdc5b465fd9cb2e8e017561d88b20b92b0889812f082a270befd10"} Jul 30 20:58:47.791853 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.791782 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" event={"ID":"684cb8ca-cdc3-4bc9-9125-dfe901a850ad","Type":"ContainerStarted","Data":"d8fd5eb348fddd6c11217093f19a356ffc9eac886faee437a10b399c7f7d098b"} Jul 30 20:58:47.791853 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:47.791802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" event={"ID":"684cb8ca-cdc3-4bc9-9125-dfe901a850ad","Type":"ContainerStarted","Data":"80f078c50c6e6c2259fee4988ca9af28aa5f378ff2a9b769a06d49bde78e5e6e"} Jul 30 20:58:48.240244 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.240216 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:48.240990 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.240972 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:48.424705 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.424632 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 20:58:48.579242 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:48.579209 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a397cc_2196_451f_a6c7_13895a10c505.slice/crio-190c1fe88f8125d38dd46ce49b2182803d9cc72c4d448e2b0d355f8f15875f92 WatchSource:0}: Error finding container 190c1fe88f8125d38dd46ce49b2182803d9cc72c4d448e2b0d355f8f15875f92: Status 404 returned error can't find the container with id 190c1fe88f8125d38dd46ce49b2182803d9cc72c4d448e2b0d355f8f15875f92 Jul 30 20:58:48.580340 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.580319 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 20:58:48.795986 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.795943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"190c1fe88f8125d38dd46ce49b2182803d9cc72c4d448e2b0d355f8f15875f92"} Jul 30 20:58:48.797370 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.797347 2577 generic.go:356] "Generic (PLEG): container finished" podID="30c8925e-a3ed-49ab-b7d4-95f6ba98e314" containerID="9a519320ea2898aa64ec7108b5797b8a20a928a220f7033579650ff761baa6c9" exitCode=0 Jul 30 20:58:48.797478 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.797428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gfhnv" event={"ID":"30c8925e-a3ed-49ab-b7d4-95f6ba98e314","Type":"ContainerDied","Data":"9a519320ea2898aa64ec7108b5797b8a20a928a220f7033579650ff761baa6c9"} Jul 30 20:58:48.799564 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.799543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" event={"ID":"684cb8ca-cdc3-4bc9-9125-dfe901a850ad","Type":"ContainerStarted","Data":"ee9318b25aa477180c88ee6587cf4764fdc2ea5b0d18b635e32fa13a1976a2b0"} Jul 30 20:58:48.831795 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:48.831750 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-4lz9s" podStartSLOduration=1.6993481780000002 podStartE2EDuration="2.831737415s" totalImagesPullingTime="1.132389237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:48.830660069 +0000 UTC m=+86.927886091" watchObservedRunningTime="2026-07-30 20:58:48.831737415 +0000 UTC m=+86.928963207" Jul 30 20:58:49.807379 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:49.807344 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gfhnv" event={"ID":"30c8925e-a3ed-49ab-b7d4-95f6ba98e314","Type":"ContainerStarted","Data":"e0d181c9034d345e12a276249a9e57f8991429ab6280b518253d4e7c6f5a6a1a"} Jul 30 20:58:49.807658 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:49.807442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gfhnv" event={"ID":"30c8925e-a3ed-49ab-b7d4-95f6ba98e314","Type":"ContainerStarted","Data":"11718e317368f7c61f57fbe773f9af299821e4bea985d567fb5db453fa85288e"} Jul 30 20:58:49.827253 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:49.827212 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gfhnv" podStartSLOduration=2.71416931 podStartE2EDuration="3.827198248s" totalImagesPullingTime="1.04789877s" totalInitContainerRuntime="65.130168ms" isStatefulPod=true podCreationTimestamp="2026-07-30 20:58:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:49.825700281 +0000 UTC m=+87.922926099" watchObservedRunningTime="2026-07-30 20:58:49.827198248 +0000 UTC m=+87.924424058" Jul 30 20:58:50.812921 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:50.812887 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0" exitCode=0 Jul 30 20:58:50.813419 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:50.812972 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0"} Jul 30 20:58:51.185367 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.185293 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f"] Jul 30 20:58:51.188449 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.188428 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.191015 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.190994 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kf62l\"" Jul 30 20:58:51.191144 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.191083 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 30 20:58:51.197430 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.197407 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f"] Jul 30 20:58:51.265495 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.265471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7cjz\" (UniqueName: \"kubernetes.io/projected/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-kube-api-access-d7cjz\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.265592 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.265531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.366725 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.366688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.366825 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.366748 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7cjz\" (UniqueName: \"kubernetes.io/projected/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-kube-api-access-d7cjz\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.366865 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:51.366840 2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 30 20:58:51.366924 ip-10-0-133-49 kubenswrapper[2577]: E0730 20:58:51.366913 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert podName:7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3 nodeName:}" failed. No retries permitted until 2026-07-30 20:58:51.866893877 +0000 UTC m=+89.964119648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-5b56f" (UID: "7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3") : secret "monitoring-plugin-cert" not found Jul 30 20:58:51.375936 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.375908 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7cjz\" (UniqueName: \"kubernetes.io/projected/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-kube-api-access-d7cjz\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.672490 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.672460 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-668ff44fbf-vn8jf"] Jul 30 20:58:51.675893 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.675862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.679678 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.679219 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 30 20:58:51.679678 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.679257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 30 20:58:51.679678 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.679257 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 30 20:58:51.679678 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.679554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 30 20:58:51.683984 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.679956 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cdlhd\"" Jul 30 20:58:51.683984 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.682619 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 30 20:58:51.688567 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.688547 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 30 20:58:51.690080 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.690055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-668ff44fbf-vn8jf"] Jul 30 20:58:51.770509 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770479 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-metrics-client-ca\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770645 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770859 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj59x\" (UniqueName: \"kubernetes.io/projected/a3895f37-9e7c-4142-87b3-a66fa6907ac1-kube-api-access-kj59x\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770859 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-federate-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.770859 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.770808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-serving-certs-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.871783 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.871754 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.871791 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-serving-certs-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.871815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.871862 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.871892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-metrics-client-ca\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872159 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872474 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872191 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj59x\" (UniqueName: \"kubernetes.io/projected/a3895f37-9e7c-4142-87b3-a66fa6907ac1-kube-api-access-kj59x\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872474 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-federate-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872840 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-serving-certs-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872840 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872775 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.872840 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.872777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3895f37-9e7c-4142-87b3-a66fa6907ac1-metrics-client-ca\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.874695 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.874670 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-telemeter-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.874925 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.874903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-5b56f\" (UID: \"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:51.874983 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.874903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.874983 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.874905 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.874983 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.874945 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a3895f37-9e7c-4142-87b3-a66fa6907ac1-federate-client-tls\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.881024 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.881005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj59x\" (UniqueName: \"kubernetes.io/projected/a3895f37-9e7c-4142-87b3-a66fa6907ac1-kube-api-access-kj59x\") pod \"telemeter-client-668ff44fbf-vn8jf\" (UID: \"a3895f37-9e7c-4142-87b3-a66fa6907ac1\") " pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:51.991286 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:51.991245 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" Jul 30 20:58:52.098175 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.098142 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:52.130319 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.130287 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-668ff44fbf-vn8jf"] Jul 30 20:58:52.349319 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:52.349243 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3895f37_9e7c_4142_87b3_a66fa6907ac1.slice/crio-1db90d2317daae59300c63834f054e50d7ac74a5051cae274fda3f262fb07aa3 WatchSource:0}: Error finding container 1db90d2317daae59300c63834f054e50d7ac74a5051cae274fda3f262fb07aa3: Status 404 returned error can't find the container with id 1db90d2317daae59300c63834f054e50d7ac74a5051cae274fda3f262fb07aa3 Jul 30 20:58:52.476661 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.476633 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f"] Jul 30 20:58:52.479041 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:52.479019 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b11a5f1_5ec5_481d_8e04_ff7d3d8303e3.slice/crio-c81deb57addbbd918d17af6ff3375a38a3595e08a7d4a8e08b0935dc21dcbe19 WatchSource:0}: Error finding container c81deb57addbbd918d17af6ff3375a38a3595e08a7d4a8e08b0935dc21dcbe19: Status 404 returned error can't find the container with id c81deb57addbbd918d17af6ff3375a38a3595e08a7d4a8e08b0935dc21dcbe19 Jul 30 20:58:52.676134 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.676090 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 20:58:52.687161 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.687138 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.689837 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.689818 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 30 20:58:52.690068 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 30 20:58:52.690167 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690090 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 30 20:58:52.690231 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690195 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 30 20:58:52.690285 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690237 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 30 20:58:52.690333 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 30 20:58:52.690386 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690352 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 30 20:58:52.690685 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690669 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 30 20:58:52.690778 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690707 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 30 20:58:52.690778 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690758 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 30 20:58:52.690889 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.690848 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-18t54923q9c32\"" Jul 30 20:58:52.691321 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.691308 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 30 20:58:52.691394 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.691376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 30 20:58:52.691792 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.691323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n2275\"" Jul 30 20:58:52.691792 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.691367 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 30 20:58:52.691792 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.691323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 30 20:58:52.692846 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.692826 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 30 20:58:52.699002 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.698985 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 20:58:52.780322 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780294 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780421 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780332 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780421 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780421 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780523 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780523 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780523 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780612 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780540 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780612 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780572 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780682 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780682 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780682 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780667 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780749 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780770 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780763 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780909 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780778 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780909 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780800 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgl4l\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.780909 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.780835 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.822685 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.822660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa"} Jul 30 20:58:52.822822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.822722 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c"} Jul 30 20:58:52.822822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.822762 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc"} Jul 30 20:58:52.822822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.822797 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67"} Jul 30 20:58:52.822822 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.822822 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc"} Jul 30 20:58:52.823759 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.823734 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" event={"ID":"a3895f37-9e7c-4142-87b3-a66fa6907ac1","Type":"ContainerStarted","Data":"1db90d2317daae59300c63834f054e50d7ac74a5051cae274fda3f262fb07aa3"} Jul 30 20:58:52.824782 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.824764 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" event={"ID":"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3","Type":"ContainerStarted","Data":"c81deb57addbbd918d17af6ff3375a38a3595e08a7d4a8e08b0935dc21dcbe19"} Jul 30 20:58:52.881363 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgl4l\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881363 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881338 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881369 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881410 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881478 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881599 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881638 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881698 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.881758 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881786 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881839 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881847 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881911 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881974 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881984 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.881999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.882035 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882217 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.882068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882759 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.882250 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882759 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.882529 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.882759 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.882694 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.883639 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.883604 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.884171 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.884147 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.885089 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.885056 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.885728 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.885265 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.885728 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.885328 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.885728 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.885666 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886320 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.885991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886320 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.886268 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886473 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.886348 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886473 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.886461 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886846 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.886827 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.886889 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.886856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.887181 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.887164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.887509 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.887492 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.897298 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.897279 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgl4l\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l\") pod \"prometheus-k8s-0\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:52.999307 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:52.999287 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:58:53.152424 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.152369 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 20:58:53.155213 ip-10-0-133-49 kubenswrapper[2577]: W0730 20:58:53.155187 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e88114_0c01_4294_a5e2_f5f6bfd9cdf8.slice/crio-abece28a99dfb160bc94e0d5dffe5fe59183e9b694dfb10020adb5f20db9834d WatchSource:0}: Error finding container abece28a99dfb160bc94e0d5dffe5fe59183e9b694dfb10020adb5f20db9834d: Status 404 returned error can't find the container with id abece28a99dfb160bc94e0d5dffe5fe59183e9b694dfb10020adb5f20db9834d Jul 30 20:58:53.833445 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.833391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerStarted","Data":"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597"} Jul 30 20:58:53.835061 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.835030 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" exitCode=0 Jul 30 20:58:53.835218 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.835106 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} Jul 30 20:58:53.835218 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.835201 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"abece28a99dfb160bc94e0d5dffe5fe59183e9b694dfb10020adb5f20db9834d"} Jul 30 20:58:53.862220 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:53.862159 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.339451113 podStartE2EDuration="6.862140462s" totalImagesPullingTime="3.507613557s" totalInitContainerRuntime="15.075792ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:53.860180032 +0000 UTC m=+91.957405878" watchObservedRunningTime="2026-07-30 20:58:53.862140462 +0000 UTC m=+91.959366257" Jul 30 20:58:54.840858 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.840776 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" event={"ID":"7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3","Type":"ContainerStarted","Data":"50e949572b62d486a02e71404e818026f82d32b2ab73c574231375a6f348927d"} Jul 30 20:58:54.840858 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.840838 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:54.843214 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.843187 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" event={"ID":"a3895f37-9e7c-4142-87b3-a66fa6907ac1","Type":"ContainerStarted","Data":"a87e934d25a942921a1150f214bda4e686b9dd48f0c713c0fd20f2f716bafd93"} Jul 30 20:58:54.843331 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.843236 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" event={"ID":"a3895f37-9e7c-4142-87b3-a66fa6907ac1","Type":"ContainerStarted","Data":"a62aed429c1ab4f4dcf1d55c41ebba1202e12f8bd2ed4792323239cca70f92ab"} Jul 30 20:58:54.843331 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.843257 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" event={"ID":"a3895f37-9e7c-4142-87b3-a66fa6907ac1","Type":"ContainerStarted","Data":"b8a466f39d91bbd6e9db2948f25b2b9b55fa844cbb41f78889aac886ad13e5b8"} Jul 30 20:58:54.845943 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.845922 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" Jul 30 20:58:54.857495 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.857358 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-5b56f" podStartSLOduration=1.799669562 podStartE2EDuration="3.857342527s" totalImagesPullingTime="2.057672965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:54.856890476 +0000 UTC m=+92.954116271" watchObservedRunningTime="2026-07-30 20:58:54.857342527 +0000 UTC m=+92.954568321" Jul 30 20:58:54.887340 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:54.887298 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-668ff44fbf-vn8jf" podStartSLOduration=1.656308178 podStartE2EDuration="3.887283714s" totalImagesPullingTime="2.230975536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:54.877887016 +0000 UTC m=+92.975112846" watchObservedRunningTime="2026-07-30 20:58:54.887283714 +0000 UTC m=+92.984509509" Jul 30 20:58:56.740404 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:56.740374 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5964d6864-77nk9" Jul 30 20:58:57.860897 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:57.860857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} Jul 30 20:58:57.861330 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:57.860957 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} Jul 30 20:58:59.872380 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:59.872347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} Jul 30 20:58:59.872801 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:59.872455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} Jul 30 20:58:59.872801 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:59.872502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} Jul 30 20:58:59.872801 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:59.872550 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerStarted","Data":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} Jul 30 20:58:59.912047 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:58:59.911986 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.95465755 podStartE2EDuration="7.91196577s" totalImagesPullingTime="4.934648311s" totalInitContainerRuntime="22.659909ms" isStatefulPod=false podCreationTimestamp="2026-07-30 20:58:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 20:58:59.910222084 +0000 UTC m=+98.007447898" watchObservedRunningTime="2026-07-30 20:58:59.91196577 +0000 UTC m=+98.009191564" Jul 30 20:59:02.999538 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:02.999484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:59:04.729511 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:04.729484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ftb44" Jul 30 20:59:20.955816 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:20.955784 2577 generic.go:356] "Generic (PLEG): container finished" podID="13172577-97de-4bcf-b572-6ccbdecee317" containerID="6345c7807f1b482e696dece3c5b4591dd1720786c22c8478073ebd5bceb26003" exitCode=0 Jul 30 20:59:20.956184 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:20.955854 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" event={"ID":"13172577-97de-4bcf-b572-6ccbdecee317","Type":"ContainerDied","Data":"6345c7807f1b482e696dece3c5b4591dd1720786c22c8478073ebd5bceb26003"} Jul 30 20:59:20.956184 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:20.956144 2577 scope.go:117] "RemoveContainer" containerID="6345c7807f1b482e696dece3c5b4591dd1720786c22c8478073ebd5bceb26003" Jul 30 20:59:21.961983 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:21.961951 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-jg46g" event={"ID":"13172577-97de-4bcf-b572-6ccbdecee317","Type":"ContainerStarted","Data":"94fe042afcf2356af15043d13f4750a3dbac70cd1cc5ec10f0149a4f23141a74"} Jul 30 20:59:25.978023 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:25.977948 2577 generic.go:356] "Generic (PLEG): container finished" podID="0d709fe7-5c99-4cf1-a341-ed186b3a6efe" containerID="26e1bf2f213ac82b513d9d02597350a291e2383d1a92f13a0eba5ac391e99e61" exitCode=0 Jul 30 20:59:25.978023 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:25.978009 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-tpn89" event={"ID":"0d709fe7-5c99-4cf1-a341-ed186b3a6efe","Type":"ContainerDied","Data":"26e1bf2f213ac82b513d9d02597350a291e2383d1a92f13a0eba5ac391e99e61"} Jul 30 20:59:25.978464 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:25.978297 2577 scope.go:117] "RemoveContainer" containerID="26e1bf2f213ac82b513d9d02597350a291e2383d1a92f13a0eba5ac391e99e61" Jul 30 20:59:26.641379 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:26.641343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54b496f858-sg6t2_3a4b724f-e7ba-409c-bf4f-7d193d68d43e/router/0.log" Jul 30 20:59:26.657150 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:26.657107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6th8_d4999865-691c-47a9-b861-11d7f8e0544f/serve-healthcheck-canary/0.log" Jul 30 20:59:26.983729 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:26.983659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-tpn89" event={"ID":"0d709fe7-5c99-4cf1-a341-ed186b3a6efe","Type":"ContainerStarted","Data":"a897be8128f00feac1591fb9f740cbd714210f2662527e0334ec8133c93f7cea"} Jul 30 20:59:36.019860 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:36.019831 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5aaf4aa-b2d6-46d2-92bc-068108b91d01" containerID="6aa174b021536dac70612b4c936a78df407d5cde15a9f181063e1ec934286635" exitCode=0 Jul 30 20:59:36.020283 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:36.019904 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" event={"ID":"f5aaf4aa-b2d6-46d2-92bc-068108b91d01","Type":"ContainerDied","Data":"6aa174b021536dac70612b4c936a78df407d5cde15a9f181063e1ec934286635"} Jul 30 20:59:36.020365 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:36.020349 2577 scope.go:117] "RemoveContainer" containerID="6aa174b021536dac70612b4c936a78df407d5cde15a9f181063e1ec934286635" Jul 30 20:59:37.025995 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:37.025961 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-784f97bcf6-mpkmx" event={"ID":"f5aaf4aa-b2d6-46d2-92bc-068108b91d01","Type":"ContainerStarted","Data":"674285e8151d5b16bcd11968d1d4be51df7bfd7b6914430ea6bd5a3041984658"} Jul 30 20:59:53.000312 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:53.000269 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:59:53.015741 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:53.015711 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 20:59:53.107454 ip-10-0-133-49 kubenswrapper[2577]: I0730 20:59:53.107431 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:06.821666 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.821624 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:06.822223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822054 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="alertmanager" containerID="cri-o://e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" gracePeriod=120 Jul 30 21:00:06.822223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822095 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-metric" containerID="cri-o://56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" gracePeriod=120 Jul 30 21:00:06.822223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822161 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="config-reloader" containerID="cri-o://fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" gracePeriod=120 Jul 30 21:00:06.822223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822102 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-web" containerID="cri-o://a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" gracePeriod=120 Jul 30 21:00:06.822223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822172 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="prom-label-proxy" containerID="cri-o://e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" gracePeriod=120 Jul 30 21:00:06.822459 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:06.822172 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy" containerID="cri-o://4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" gracePeriod=120 Jul 30 21:00:07.151557 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151469 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" exitCode=0 Jul 30 21:00:07.151557 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151495 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" exitCode=0 Jul 30 21:00:07.151557 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151504 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" exitCode=0 Jul 30 21:00:07.151557 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151512 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" exitCode=0 Jul 30 21:00:07.151557 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151543 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597"} Jul 30 21:00:07.151816 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151604 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c"} Jul 30 21:00:07.151816 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67"} Jul 30 21:00:07.151816 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:07.151654 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc"} Jul 30 21:00:08.071205 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.071178 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.157921 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.157823 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" exitCode=0 Jul 30 21:00:08.157921 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.157849 2577 generic.go:356] "Generic (PLEG): container finished" podID="04a397cc-2196-451f-a6c7-13895a10c505" containerID="a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" exitCode=0 Jul 30 21:00:08.157921 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.157905 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.157921 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.157906 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa"} Jul 30 21:00:08.158275 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.157982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc"} Jul 30 21:00:08.158275 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.158013 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"04a397cc-2196-451f-a6c7-13895a10c505","Type":"ContainerDied","Data":"190c1fe88f8125d38dd46ce49b2182803d9cc72c4d448e2b0d355f8f15875f92"} Jul 30 21:00:08.158275 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.158067 2577 scope.go:117] "RemoveContainer" containerID="e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" Jul 30 21:00:08.166012 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.165994 2577 scope.go:117] "RemoveContainer" containerID="56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" Jul 30 21:00:08.173062 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.173043 2577 scope.go:117] "RemoveContainer" containerID="4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" Jul 30 21:00:08.180143 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.180107 2577 scope.go:117] "RemoveContainer" containerID="a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" Jul 30 21:00:08.186898 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.186869 2577 scope.go:117] "RemoveContainer" containerID="fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" Jul 30 21:00:08.193945 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.193928 2577 scope.go:117] "RemoveContainer" containerID="e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" Jul 30 21:00:08.201264 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.201236 2577 scope.go:117] "RemoveContainer" containerID="d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0" Jul 30 21:00:08.208223 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.208205 2577 scope.go:117] "RemoveContainer" containerID="e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" Jul 30 21:00:08.208534 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.208507 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597\": container with ID starting with e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597 not found: ID does not exist" containerID="e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" Jul 30 21:00:08.208620 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.208547 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597"} err="failed to get container status \"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597\": rpc error: code = NotFound desc = could not find container \"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597\": container with ID starting with e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597 not found: ID does not exist" Jul 30 21:00:08.208620 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.208591 2577 scope.go:117] "RemoveContainer" containerID="56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" Jul 30 21:00:08.208880 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.208854 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa\": container with ID starting with 56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa not found: ID does not exist" containerID="56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" Jul 30 21:00:08.208919 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.208887 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa"} err="failed to get container status \"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa\": rpc error: code = NotFound desc = could not find container \"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa\": container with ID starting with 56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa not found: ID does not exist" Jul 30 21:00:08.208919 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.208903 2577 scope.go:117] "RemoveContainer" containerID="4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" Jul 30 21:00:08.209106 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.209086 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c\": container with ID starting with 4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c not found: ID does not exist" containerID="4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" Jul 30 21:00:08.209173 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209123 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c"} err="failed to get container status \"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c\": rpc error: code = NotFound desc = could not find container \"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c\": container with ID starting with 4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c not found: ID does not exist" Jul 30 21:00:08.209173 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209141 2577 scope.go:117] "RemoveContainer" containerID="a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" Jul 30 21:00:08.209355 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.209337 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc\": container with ID starting with a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc not found: ID does not exist" containerID="a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" Jul 30 21:00:08.209394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209359 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc"} err="failed to get container status \"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc\": rpc error: code = NotFound desc = could not find container \"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc\": container with ID starting with a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc not found: ID does not exist" Jul 30 21:00:08.209394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209373 2577 scope.go:117] "RemoveContainer" containerID="fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" Jul 30 21:00:08.209607 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.209589 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67\": container with ID starting with fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67 not found: ID does not exist" containerID="fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" Jul 30 21:00:08.209654 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209612 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67"} err="failed to get container status \"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67\": rpc error: code = NotFound desc = could not find container \"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67\": container with ID starting with fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67 not found: ID does not exist" Jul 30 21:00:08.209654 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209625 2577 scope.go:117] "RemoveContainer" containerID="e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" Jul 30 21:00:08.209868 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.209853 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc\": container with ID starting with e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc not found: ID does not exist" containerID="e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" Jul 30 21:00:08.209922 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209871 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc"} err="failed to get container status \"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc\": rpc error: code = NotFound desc = could not find container \"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc\": container with ID starting with e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc not found: ID does not exist" Jul 30 21:00:08.209922 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.209883 2577 scope.go:117] "RemoveContainer" containerID="d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0" Jul 30 21:00:08.210102 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:08.210086 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0\": container with ID starting with d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0 not found: ID does not exist" containerID="d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0" Jul 30 21:00:08.210390 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210108 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0"} err="failed to get container status \"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0\": rpc error: code = NotFound desc = could not find container \"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0\": container with ID starting with d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0 not found: ID does not exist" Jul 30 21:00:08.210390 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210137 2577 scope.go:117] "RemoveContainer" containerID="e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597" Jul 30 21:00:08.210390 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210354 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597"} err="failed to get container status \"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597\": rpc error: code = NotFound desc = could not find container \"e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597\": container with ID starting with e04e7f87cf42019d71d9e04b14ab0c954d15a8b41064ce6f4dcb1627707c2597 not found: ID does not exist" Jul 30 21:00:08.210390 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210370 2577 scope.go:117] "RemoveContainer" containerID="56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa" Jul 30 21:00:08.210599 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210582 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa"} err="failed to get container status \"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa\": rpc error: code = NotFound desc = could not find container \"56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa\": container with ID starting with 56040a6d5f4dc30d51dae0d96d815bbf1a4996401180f0d5c40455690cd6f6fa not found: ID does not exist" Jul 30 21:00:08.210639 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210600 2577 scope.go:117] "RemoveContainer" containerID="4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c" Jul 30 21:00:08.210796 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210777 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c"} err="failed to get container status \"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c\": rpc error: code = NotFound desc = could not find container \"4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c\": container with ID starting with 4410499fde7dc9562ce2b71fa02688cc43d8c3a01e067c2f011edd9f4fb8395c not found: ID does not exist" Jul 30 21:00:08.210838 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210797 2577 scope.go:117] "RemoveContainer" containerID="a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc" Jul 30 21:00:08.210979 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210963 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc"} err="failed to get container status \"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc\": rpc error: code = NotFound desc = could not find container \"a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc\": container with ID starting with a0a9d8f4d33e7d3082b3abeade045cd25ab541e3e543eb7e7089dece52c4f0dc not found: ID does not exist" Jul 30 21:00:08.211020 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.210979 2577 scope.go:117] "RemoveContainer" containerID="fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67" Jul 30 21:00:08.211181 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.211161 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67"} err="failed to get container status \"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67\": rpc error: code = NotFound desc = could not find container \"fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67\": container with ID starting with fe0f45ea8e437c52c12764c31beb1facb4d11e143c4514882fcd6177dac8dd67 not found: ID does not exist" Jul 30 21:00:08.211228 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.211182 2577 scope.go:117] "RemoveContainer" containerID="e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc" Jul 30 21:00:08.211361 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.211345 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc"} err="failed to get container status \"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc\": rpc error: code = NotFound desc = could not find container \"e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc\": container with ID starting with e7f41d2ca91a2ef58b4a2c6b9e6edcccce55865727ac06c20943345e73b30cbc not found: ID does not exist" Jul 30 21:00:08.211404 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.211361 2577 scope.go:117] "RemoveContainer" containerID="d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0" Jul 30 21:00:08.211536 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.211519 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0"} err="failed to get container status \"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0\": rpc error: code = NotFound desc = could not find container \"d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0\": container with ID starting with d35af1f2b8210fb03fa845d7875c6d10277a50db0332b1a2ef9ac78609942dc0 not found: ID does not exist" Jul 30 21:00:08.218970 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.218949 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219077 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.218996 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219077 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219026 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219077 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219057 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219249 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219091 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219249 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219139 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219355 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219320 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:08.219473 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219453 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219544 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219514 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219599 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219541 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219599 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219579 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219704 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219627 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219704 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219658 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.219704 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.219683 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6bl6\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6\") pod \"04a397cc-2196-451f-a6c7-13895a10c505\" (UID: \"04a397cc-2196-451f-a6c7-13895a10c505\") " Jul 30 21:00:08.220180 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.220067 2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-metrics-client-ca\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.220273 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.220189 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:08.220608 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.220577 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:00:08.223374 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.223346 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.223621 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.223536 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.223621 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.223579 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume" (OuterVolumeSpecName: "config-volume") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.223621 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.223595 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.223895 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.223875 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out" (OuterVolumeSpecName: "config-out") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:00:08.224046 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.224026 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:00:08.224313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.224288 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6" (OuterVolumeSpecName: "kube-api-access-k6bl6") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "kube-api-access-k6bl6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:00:08.225138 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.225095 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.227773 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.227747 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.234423 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.234397 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config" (OuterVolumeSpecName: "web-config") pod "04a397cc-2196-451f-a6c7-13895a10c505" (UID: "04a397cc-2196-451f-a6c7-13895a10c505"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:08.320750 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320715 2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-cluster-tls-config\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320750 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320742 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-web-config\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320750 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320756 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320765 2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-config-volume\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320774 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320785 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320793 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-config-out\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320801 2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/04a397cc-2196-451f-a6c7-13895a10c505-alertmanager-main-db\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320811 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-main-tls\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320820 2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/04a397cc-2196-451f-a6c7-13895a10c505-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320827 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-tls-assets\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.320972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.320835 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6bl6\" (UniqueName: \"kubernetes.io/projected/04a397cc-2196-451f-a6c7-13895a10c505-kube-api-access-k6bl6\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:08.477450 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.477417 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:08.481473 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.481445 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:08.508005 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.507971 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:08.508326 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508311 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-web" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508328 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-web" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508339 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="prom-label-proxy" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508345 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="prom-label-proxy" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508355 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="init-config-reloader" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508361 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="init-config-reloader" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508368 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy" Jul 30 21:00:08.508376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508373 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508383 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-metric" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508388 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-metric" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508402 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="config-reloader" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508407 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="config-reloader" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508415 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="alertmanager" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508420 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="alertmanager" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508469 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508476 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="prom-label-proxy" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508482 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="alertmanager" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508487 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="config-reloader" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508501 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-metric" Jul 30 21:00:08.508603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.508507 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a397cc-2196-451f-a6c7-13895a10c505" containerName="kube-rbac-proxy-web" Jul 30 21:00:08.513531 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.513515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.516468 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.516430 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 30 21:00:08.516611 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.516468 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5xsv2\"" Jul 30 21:00:08.516734 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.516719 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 30 21:00:08.517018 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517000 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 30 21:00:08.517135 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 30 21:00:08.517135 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517091 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 30 21:00:08.517222 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 30 21:00:08.517397 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517383 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 30 21:00:08.517623 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.517608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 30 21:00:08.522582 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.522562 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 30 21:00:08.525636 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.525611 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:08.623598 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-web-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623598 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623606 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623678 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623696 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.623856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623851 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623887 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6mk\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-kube-api-access-vk6mk\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.623974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.624004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-config-out\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.624050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.624105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.624081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725110 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6mk\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-kube-api-access-vk6mk\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725164 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725182 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-config-out\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725263 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-web-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725677 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725516 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725677 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725553 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725677 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.725677 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.725590 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.726082 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.726053 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.726375 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.726347 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0adffd5-406c-41f9-a509-5d14702f6922-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.726496 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.726409 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.726496 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.726451 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728066 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a0adffd5-406c-41f9-a509-5d14702f6922-config-out\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728163 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728142 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728480 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728454 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728783 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728752 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728783 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728767 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.728887 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728799 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-web-config\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.729008 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.728991 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-config-volume\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.729281 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.729262 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0adffd5-406c-41f9-a509-5d14702f6922-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.730171 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.730153 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.733872 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.733851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6mk\" (UniqueName: \"kubernetes.io/projected/a0adffd5-406c-41f9-a509-5d14702f6922-kube-api-access-vk6mk\") pod \"alertmanager-main-0\" (UID: \"a0adffd5-406c-41f9-a509-5d14702f6922\") " pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.824587 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.824547 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 30 21:00:08.972387 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:08.972356 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 30 21:00:08.975491 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:00:08.975422 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0adffd5_406c_41f9_a509_5d14702f6922.slice/crio-0d89d400cc4c6bb243a4c149d640f7dc1a10bdd2b116345b6d624be0a7f1244f WatchSource:0}: Error finding container 0d89d400cc4c6bb243a4c149d640f7dc1a10bdd2b116345b6d624be0a7f1244f: Status 404 returned error can't find the container with id 0d89d400cc4c6bb243a4c149d640f7dc1a10bdd2b116345b6d624be0a7f1244f Jul 30 21:00:09.163750 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:09.163713 2577 generic.go:356] "Generic (PLEG): container finished" podID="a0adffd5-406c-41f9-a509-5d14702f6922" containerID="2e2df81fa1c759dd1ea1ed9d0bd7fe7e15ffde2442a42efec1a42981c65baf20" exitCode=0 Jul 30 21:00:09.164144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:09.163775 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerDied","Data":"2e2df81fa1c759dd1ea1ed9d0bd7fe7e15ffde2442a42efec1a42981c65baf20"} Jul 30 21:00:09.164144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:09.163852 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"0d89d400cc4c6bb243a4c149d640f7dc1a10bdd2b116345b6d624be0a7f1244f"} Jul 30 21:00:10.171293 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171205 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"8edceb04ee488d4e36d35d15015208d8261a3e5d40bb3523d17b01d3f8fa23e8"} Jul 30 21:00:10.171293 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171267 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"991a5c59f30175d011737578d2dd9221edf6f648092ffe05b789f4cc24d0b408"} Jul 30 21:00:10.171293 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"7c0ebdcea89ca277d984115cfd8a9558a1b9119bb594520b0d23964acfc9160a"} Jul 30 21:00:10.171753 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171315 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"d99a6d0544f5813f1c78fb9b25923ef8095db8bb88d91d806f7eb79429c074c9"} Jul 30 21:00:10.171753 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171338 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"abd6b103ba6399bf67e13a94f4eacec4242547ad9268c64fefa55c568c5af653"} Jul 30 21:00:10.171753 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.171362 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a0adffd5-406c-41f9-a509-5d14702f6922","Type":"ContainerStarted","Data":"e65ce1861891f2ed322b4c337a93db0214ca7e3892e4cca471f18c56a049a5e9"} Jul 30 21:00:10.199171 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.199094 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.187184739 podStartE2EDuration="2.199072517s" totalImagesPullingTime="0s" totalInitContainerRuntime="11.887778ms" isStatefulPod=false podCreationTimestamp="2026-07-30 21:00:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:00:10.198927697 +0000 UTC m=+168.296153539" watchObservedRunningTime="2026-07-30 21:00:10.199072517 +0000 UTC m=+168.296298338" Jul 30 21:00:10.409443 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:10.409413 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a397cc-2196-451f-a6c7-13895a10c505" path="/var/lib/kubelet/pods/04a397cc-2196-451f-a6c7-13895a10c505/volumes" Jul 30 21:00:11.069494 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069461 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:11.069752 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069729 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="prometheus" containerID="cri-o://29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" gracePeriod=600 Jul 30 21:00:11.069829 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069794 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="config-reloader" containerID="cri-o://141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" gracePeriod=600 Jul 30 21:00:11.069829 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069780 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="thanos-sidecar" containerID="cri-o://661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" gracePeriod=600 Jul 30 21:00:11.069928 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069832 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" gracePeriod=600 Jul 30 21:00:11.069928 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069780 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-web" containerID="cri-o://0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" gracePeriod=600 Jul 30 21:00:11.069928 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.069780 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy" containerID="cri-o://cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" gracePeriod=600 Jul 30 21:00:11.314402 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.314375 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:11.348693 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348614 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.348851 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348731 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.348851 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348776 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.348851 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348803 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.348851 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348825 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.348851 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348847 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348870 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348903 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348936 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.348968 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349004 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349032 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349056 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349085 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349127 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349130 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349153 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349162 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349180 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349211 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.349408 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349242 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgl4l\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.350070 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349554 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.350070 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349571 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.350070 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.349941 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.351621 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.352441 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.352754 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.352762 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.352844 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.353394 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.355309 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.353464 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config" (OuterVolumeSpecName: "config") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.356060 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.355986 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l" (OuterVolumeSpecName: "kube-api-access-hgl4l") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "kube-api-access-hgl4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:00:11.356060 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.356022 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:00:11.356243 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.356084 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.356361 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.356340 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out" (OuterVolumeSpecName: "config-out") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:00:11.356792 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.356766 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.357243 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.357221 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.357348 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.357241 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.358242 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.358215 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.367783 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.367752 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config" (OuterVolumeSpecName: "web-config") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.450554 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450503 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy\") pod \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\" (UID: \"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8\") " Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450658 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgl4l\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-kube-api-access-hgl4l\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450671 2577 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450682 2577 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-metrics-client-certs\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450691 2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-config-out\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450699 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450707 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450717 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450727 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-metrics-client-ca\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450736 2577 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450745 2577 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450753 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-db\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450761 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450770 2577 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-grpc-tls\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450813 2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-web-config\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450822 2577 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450831 2577 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.450982 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.450839 2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-tls-assets\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:11.452509 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.452478 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" (UID: "84e88114-0c01-4294-a5e2-f5f6bfd9cdf8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:00:11.551836 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:11.551785 2577 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8-secret-kube-rbac-proxy\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:00:12.182911 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182878 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" exitCode=0 Jul 30 21:00:12.182911 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182906 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" exitCode=0 Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182919 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" exitCode=0 Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182931 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" exitCode=0 Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182941 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" exitCode=0 Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182951 2577 generic.go:356] "Generic (PLEG): container finished" podID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" exitCode=0 Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182959 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.182973 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183049 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183073 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} Jul 30 21:00:12.183099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183091 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.183482 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183095 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} Jul 30 21:00:12.183482 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} Jul 30 21:00:12.183482 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.183178 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"84e88114-0c01-4294-a5e2-f5f6bfd9cdf8","Type":"ContainerDied","Data":"abece28a99dfb160bc94e0d5dffe5fe59183e9b694dfb10020adb5f20db9834d"} Jul 30 21:00:12.191575 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.191557 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.198542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.198525 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.205144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.205127 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.208476 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.208405 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:12.212516 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.212497 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.213984 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.213965 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:12.219195 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.219177 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.226093 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.226072 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.232788 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.232762 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.233027 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.233005 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.233093 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233041 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.233093 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233067 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.233302 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.233286 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.233371 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233309 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.233371 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233331 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.233566 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.233550 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.233622 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233577 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.233622 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233599 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.233819 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.233803 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.233854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233825 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.233854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.233839 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.234036 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.234021 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.234079 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234041 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.234079 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234055 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.234533 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.234517 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.234573 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234539 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.234573 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234554 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.234768 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:00:12.234754 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.234802 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234772 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.234802 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.234783 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.235029 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235012 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.235062 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235031 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.235257 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235240 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.235306 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235258 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.235446 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235431 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.235489 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235445 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.235688 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235670 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.235730 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235689 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.235893 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235876 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.235972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.235893 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.236070 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236054 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.236124 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236071 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.236285 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236269 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.236321 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236285 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.236480 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236463 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.236535 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236482 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.236693 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236677 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.236731 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236693 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.236920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236903 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.236962 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.236921 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.237144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237103 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.237199 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237145 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.237341 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237325 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.237379 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237342 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.237534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237518 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.237580 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237534 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.237739 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237722 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.237776 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237739 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.237945 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237929 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.237984 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.237946 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.238186 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238170 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.238225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238186 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.238385 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238369 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.238431 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238385 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.238601 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238584 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.238601 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238599 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.238789 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238771 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.238853 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238790 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.239011 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.238993 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.239083 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.239010 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.239348 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.239319 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.239348 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.239347 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.239711 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.239686 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.239795 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.239712 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.240088 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240068 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.240088 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240088 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.240354 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240336 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.240354 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240354 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.240622 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240578 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.240622 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240607 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.240818 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240800 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.240857 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.240828 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.241037 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241021 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.241037 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241035 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.241262 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241243 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.241336 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241266 2577 scope.go:117] "RemoveContainer" containerID="18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4" Jul 30 21:00:12.241511 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241494 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4"} err="failed to get container status \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": rpc error: code = NotFound desc = could not find container \"18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4\": container with ID starting with 18003c4dbe030571004844ed45f33b7feb1111417d6756900c7e07f35d651ad4 not found: ID does not exist" Jul 30 21:00:12.241563 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241513 2577 scope.go:117] "RemoveContainer" containerID="cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1" Jul 30 21:00:12.241563 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241550 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:12.241740 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241723 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1"} err="failed to get container status \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": rpc error: code = NotFound desc = could not find container \"cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1\": container with ID starting with cf1189fda868053f49f3307e2c68e8d92a717956df80e91dca5309befb1217e1 not found: ID does not exist" Jul 30 21:00:12.241807 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241742 2577 scope.go:117] "RemoveContainer" containerID="0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77" Jul 30 21:00:12.241903 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241887 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-thanos" Jul 30 21:00:12.241938 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241907 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-thanos" Jul 30 21:00:12.241938 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241920 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="init-config-reloader" Jul 30 21:00:12.241938 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241926 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="init-config-reloader" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241939 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77"} err="failed to get container status \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": rpc error: code = NotFound desc = could not find container \"0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77\": container with ID starting with 0e9303ba358d5683a47a826efcf1dd1eac76a54139398ad8124cfd23d9386b77 not found: ID does not exist" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241950 2577 scope.go:117] "RemoveContainer" containerID="661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241956 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="config-reloader" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241962 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="config-reloader" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241971 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="thanos-sidecar" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241976 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="thanos-sidecar" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241983 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="prometheus" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.241988 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="prometheus" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242001 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-web" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242006 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-web" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242016 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy" Jul 30 21:00:12.242027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242021 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242098 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="config-reloader" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242106 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="thanos-sidecar" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242136 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-thanos" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242145 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="prometheus" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242156 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy-web" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242161 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" containerName="kube-rbac-proxy" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242162 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4"} err="failed to get container status \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": rpc error: code = NotFound desc = could not find container \"661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4\": container with ID starting with 661e1ced5cf14fdd9d28c66145bfbbd00b1c79bb5e10cc6de3d3167226fbabb4 not found: ID does not exist" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242178 2577 scope.go:117] "RemoveContainer" containerID="141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242383 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1"} err="failed to get container status \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": rpc error: code = NotFound desc = could not find container \"141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1\": container with ID starting with 141d7f8df53f8efc51642c4d732c9c0dac0e82a718c524a006aecf576b19c6a1 not found: ID does not exist" Jul 30 21:00:12.242487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242406 2577 scope.go:117] "RemoveContainer" containerID="29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc" Jul 30 21:00:12.242823 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242611 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc"} err="failed to get container status \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": rpc error: code = NotFound desc = could not find container \"29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc\": container with ID starting with 29346740fcb38ec6fd8ff09bc9b28f9d56079e9bd2e2c973ca20ff92077abbfc not found: ID does not exist" Jul 30 21:00:12.242823 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242627 2577 scope.go:117] "RemoveContainer" containerID="54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6" Jul 30 21:00:12.242823 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.242810 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6"} err="failed to get container status \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": rpc error: code = NotFound desc = could not find container \"54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6\": container with ID starting with 54aa1070132d868eacb2a316001d318b4027d48206448fceb3c6001de4cd54d6 not found: ID does not exist" Jul 30 21:00:12.247428 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.247414 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.250461 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250442 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 30 21:00:12.250537 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250495 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-n2275\"" Jul 30 21:00:12.250537 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250442 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 30 21:00:12.250647 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250608 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 30 21:00:12.250686 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250653 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 30 21:00:12.250786 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250770 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 30 21:00:12.250914 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250860 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 30 21:00:12.250914 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250909 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-18t54923q9c32\"" Jul 30 21:00:12.251051 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250962 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 30 21:00:12.251051 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.250972 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 30 21:00:12.251196 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.251075 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 30 21:00:12.251196 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.251039 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 30 21:00:12.251196 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.251152 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 30 21:00:12.251337 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.251237 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 30 21:00:12.251592 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.251577 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 30 21:00:12.253376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.253359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 30 21:00:12.256356 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.256336 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 30 21:00:12.257086 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257069 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257105 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257216 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257272 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257254 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257323 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257291 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257366 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257347 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257409 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257370 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257409 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257389 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257414 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257436 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257501 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257565 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257640 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257664 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257703 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plmfs\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-kube-api-access-plmfs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.257840 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.257736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.260686 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.260663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:12.358650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358559 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.358650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.358650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358733 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358903 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358957 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.358983 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plmfs\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-kube-api-access-plmfs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359142 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359167 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359210 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359306 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359331 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359357 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.359771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359406 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.360071 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.359926 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.360148 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.360073 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.360879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.360749 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.360879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.360754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.362728 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.362696 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.362931 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.362905 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.363203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.363178 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.363421 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.363397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.363609 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.363583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364250 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364004 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364250 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364037 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364455 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364428 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364560 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364511 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364707 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364676 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/59c57977-4e50-426a-8f8c-27ab9c3a91ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.364879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.364858 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.365021 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.365007 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.365089 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.365070 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.365555 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.365539 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/59c57977-4e50-426a-8f8c-27ab9c3a91ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.369299 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.369275 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plmfs\" (UniqueName: \"kubernetes.io/projected/59c57977-4e50-426a-8f8c-27ab9c3a91ed-kube-api-access-plmfs\") pod \"prometheus-k8s-0\" (UID: \"59c57977-4e50-426a-8f8c-27ab9c3a91ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.407994 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.407960 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84e88114-0c01-4294-a5e2-f5f6bfd9cdf8" path="/var/lib/kubelet/pods/84e88114-0c01-4294-a5e2-f5f6bfd9cdf8/volumes" Jul 30 21:00:12.557467 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.557424 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:00:12.698031 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:12.698001 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 30 21:00:12.699275 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:00:12.699249 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c57977_4e50_426a_8f8c_27ab9c3a91ed.slice/crio-11c8b1b3d86c987ae56f0627eb695ee265009622fdd80000cc602db3e08689c1 WatchSource:0}: Error finding container 11c8b1b3d86c987ae56f0627eb695ee265009622fdd80000cc602db3e08689c1: Status 404 returned error can't find the container with id 11c8b1b3d86c987ae56f0627eb695ee265009622fdd80000cc602db3e08689c1 Jul 30 21:00:13.189267 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:13.189231 2577 generic.go:356] "Generic (PLEG): container finished" podID="59c57977-4e50-426a-8f8c-27ab9c3a91ed" containerID="f4cf0decee2f0d13bbd8504bdc76639660a44d8e6ef314436a9e60d7b97bd20f" exitCode=0 Jul 30 21:00:13.189411 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:13.189285 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerDied","Data":"f4cf0decee2f0d13bbd8504bdc76639660a44d8e6ef314436a9e60d7b97bd20f"} Jul 30 21:00:13.189411 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:13.189333 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"11c8b1b3d86c987ae56f0627eb695ee265009622fdd80000cc602db3e08689c1"} Jul 30 21:00:14.197039 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"7807ad4bf38afb8ec01d030a70412d41fa0df6e81f4cd4d3c001a4af7c3fc1c5"} Jul 30 21:00:14.197418 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197081 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"50af17f072c4c5053d517fe03c8c16a237c3e768909c0a2bf8d820ded165a212"} Jul 30 21:00:14.197418 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197142 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"878ce13bde203138a378c651f8031e99c50c8039b11cfa6dec5975692d887310"} Jul 30 21:00:14.197418 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197182 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"2e626e5d8033d6b02fd0b36fc607b9e752844da98559823befe40a080098af1c"} Jul 30 21:00:14.197418 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197217 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"118541bb46ff0d97a0b369284d2ae92511bf922ecbe63961c0a1de8fef9da4fb"} Jul 30 21:00:14.197418 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.197250 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"59c57977-4e50-426a-8f8c-27ab9c3a91ed","Type":"ContainerStarted","Data":"36b5e2e90cf11131453fe27b3af5638b1e47de7c05146d961e93ab670277ef47"} Jul 30 21:00:14.227705 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:14.227645 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.203247697 podStartE2EDuration="2.22762419s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.376493ms" isStatefulPod=false podCreationTimestamp="2026-07-30 21:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:00:14.224881138 +0000 UTC m=+172.322106997" watchObservedRunningTime="2026-07-30 21:00:14.22762419 +0000 UTC m=+172.324849984" Jul 30 21:00:17.558550 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:00:17.558519 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:01:12.558423 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:01:12.558385 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:01:12.574138 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:01:12.574100 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:01:13.455152 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:01:13.455125 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 30 21:02:19.806546 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.806510 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c"] Jul 30 21:02:19.809827 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.809810 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:19.812877 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.812855 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 30 21:02:19.814027 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.814009 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 30 21:02:19.814203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.814095 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 30 21:02:19.814203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.814122 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 30 21:02:19.814203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.814135 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 30 21:02:19.814585 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.814568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tvk9w\"" Jul 30 21:02:19.824361 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.824340 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c"] Jul 30 21:02:19.936427 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.936393 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/999c8df0-a407-43be-ab37-9d963969ebb6-manager-config\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:19.936427 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.936426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-metrics-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:19.936656 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.936541 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:19.936656 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:19.936584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g28v\" (UniqueName: \"kubernetes.io/projected/999c8df0-a407-43be-ab37-9d963969ebb6-kube-api-access-8g28v\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.037313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.037278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.037511 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.037330 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g28v\" (UniqueName: \"kubernetes.io/projected/999c8df0-a407-43be-ab37-9d963969ebb6-kube-api-access-8g28v\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.037580 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.037507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/999c8df0-a407-43be-ab37-9d963969ebb6-manager-config\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.037580 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.037537 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-metrics-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.038129 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.038095 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/999c8df0-a407-43be-ab37-9d963969ebb6-manager-config\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.039966 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.039944 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-metrics-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.040045 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.039951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/999c8df0-a407-43be-ab37-9d963969ebb6-cert\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.052384 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.052359 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g28v\" (UniqueName: \"kubernetes.io/projected/999c8df0-a407-43be-ab37-9d963969ebb6-kube-api-access-8g28v\") pod \"lws-controller-manager-76d7f64c45-9sv6c\" (UID: \"999c8df0-a407-43be-ab37-9d963969ebb6\") " pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.119471 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.119389 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:20.253424 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.253401 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c"] Jul 30 21:02:20.255880 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:02:20.255849 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod999c8df0_a407_43be_ab37_9d963969ebb6.slice/crio-53c21d1975d0c37ef3bba1d028ec7c3e79e1d2f71743ed9c56a3c70fac633855 WatchSource:0}: Error finding container 53c21d1975d0c37ef3bba1d028ec7c3e79e1d2f71743ed9c56a3c70fac633855: Status 404 returned error can't find the container with id 53c21d1975d0c37ef3bba1d028ec7c3e79e1d2f71743ed9c56a3c70fac633855 Jul 30 21:02:20.700310 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:20.700276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" event={"ID":"999c8df0-a407-43be-ab37-9d963969ebb6","Type":"ContainerStarted","Data":"53c21d1975d0c37ef3bba1d028ec7c3e79e1d2f71743ed9c56a3c70fac633855"} Jul 30 21:02:21.610130 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.610084 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj"] Jul 30 21:02:21.613390 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.613367 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.629105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.629082 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 30 21:02:21.629243 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.629206 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 30 21:02:21.629367 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.629352 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 30 21:02:21.629427 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.629417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 30 21:02:21.629519 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.629444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dq824\"" Jul 30 21:02:21.645941 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.645918 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj"] Jul 30 21:02:21.753959 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.753925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.754164 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.753982 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-manifests\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.754164 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.754055 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdl7q\" (UniqueName: \"kubernetes.io/projected/4d0d7bc3-9cbb-4218-9adc-f91318f25378-kube-api-access-mdl7q\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.754164 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.754154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.754313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.754182 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-tmp\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.854866 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.854828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-manifests\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.855047 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.854880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdl7q\" (UniqueName: \"kubernetes.io/projected/4d0d7bc3-9cbb-4218-9adc-f91318f25378-kube-api-access-mdl7q\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.855047 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.854944 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.855047 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.854965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-tmp\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.855047 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.855009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.855354 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.855310 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-manifests\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.857439 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.857418 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d0d7bc3-9cbb-4218-9adc-f91318f25378-tmp\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.857734 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.857708 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-webhook-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.857734 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.857721 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4d0d7bc3-9cbb-4218-9adc-f91318f25378-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.863567 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.863517 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdl7q\" (UniqueName: \"kubernetes.io/projected/4d0d7bc3-9cbb-4218-9adc-f91318f25378-kube-api-access-mdl7q\") pod \"opendatahub-operator-controller-manager-5ddcd94768-xbvwj\" (UID: \"4d0d7bc3-9cbb-4218-9adc-f91318f25378\") " pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:21.925541 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:21.925513 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:22.796914 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:22.796883 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:02:22.797962 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:22.797943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:02:22.804931 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:22.804912 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 30 21:02:22.909455 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:22.909426 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj"] Jul 30 21:02:22.910764 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:02:22.910736 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d0d7bc3_9cbb_4218_9adc_f91318f25378.slice/crio-a225a413791168f27cf03ed717c65f6ca61307605278cbdd8e834136813746af WatchSource:0}: Error finding container a225a413791168f27cf03ed717c65f6ca61307605278cbdd8e834136813746af: Status 404 returned error can't find the container with id a225a413791168f27cf03ed717c65f6ca61307605278cbdd8e834136813746af Jul 30 21:02:23.716046 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:23.716014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" event={"ID":"4d0d7bc3-9cbb-4218-9adc-f91318f25378","Type":"ContainerStarted","Data":"a225a413791168f27cf03ed717c65f6ca61307605278cbdd8e834136813746af"} Jul 30 21:02:23.717379 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:23.717355 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" event={"ID":"999c8df0-a407-43be-ab37-9d963969ebb6","Type":"ContainerStarted","Data":"495e8ff70bcb96608955af05e042b5cf1d2b81fd991438cac633d09e4383083f"} Jul 30 21:02:23.717493 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:23.717478 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:23.739978 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:23.739927 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" podStartSLOduration=2.165228152 podStartE2EDuration="4.739912535s" totalImagesPullingTime="2.574684383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:23.737508899 +0000 UTC m=+301.834734705" watchObservedRunningTime="2026-07-30 21:02:23.739912535 +0000 UTC m=+301.837138328" Jul 30 21:02:26.733176 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:26.733145 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" event={"ID":"4d0d7bc3-9cbb-4218-9adc-f91318f25378","Type":"ContainerStarted","Data":"2a18b5ac960300452d4e20749f062e39c910e0652714994b413c76d41feb0a1c"} Jul 30 21:02:28.742378 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:28.742346 2577 generic.go:356] "Generic (PLEG): container finished" podID="4d0d7bc3-9cbb-4218-9adc-f91318f25378" containerID="2a18b5ac960300452d4e20749f062e39c910e0652714994b413c76d41feb0a1c" exitCode=0 Jul 30 21:02:28.742732 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:28.742414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" event={"ID":"4d0d7bc3-9cbb-4218-9adc-f91318f25378","Type":"ContainerDied","Data":"2a18b5ac960300452d4e20749f062e39c910e0652714994b413c76d41feb0a1c"} Jul 30 21:02:28.742984 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:28.742969 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 21:02:29.748772 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:29.748742 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" event={"ID":"4d0d7bc3-9cbb-4218-9adc-f91318f25378","Type":"ContainerStarted","Data":"74d3ead1057eb0055b9bbe3ceb27234bd7b5796ed9358fd418438969f56e468a"} Jul 30 21:02:29.749153 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:29.748962 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:29.782860 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:29.782815 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" podStartSLOduration=3.533705227 podStartE2EDuration="8.782796957s" totalImagesPullingTime="4.181254967s" totalInitContainerRuntime="1.067836763s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:29.781418884 +0000 UTC m=+307.878644678" watchObservedRunningTime="2026-07-30 21:02:29.782796957 +0000 UTC m=+307.880022749" Jul 30 21:02:34.725796 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:34.725770 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76d7f64c45-9sv6c" Jul 30 21:02:40.756021 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:40.755992 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5ddcd94768-xbvwj" Jul 30 21:02:53.086527 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.086492 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7"] Jul 30 21:02:53.089900 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.089877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.092876 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.092859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7ht9n\"" Jul 30 21:02:53.092988 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.092859 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 30 21:02:53.093922 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.093907 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 30 21:02:53.103986 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.103958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7"] Jul 30 21:02:53.121102 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.121066 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.121411 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.121385 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6rc\" (UniqueName: \"kubernetes.io/projected/488a546e-d475-442a-91a2-c1532d8a1d0b-kube-api-access-ml6rc\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.121558 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.121534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488a546e-d475-442a-91a2-c1532d8a1d0b-tmp\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.222065 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.222028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.222269 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.222088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6rc\" (UniqueName: \"kubernetes.io/projected/488a546e-d475-442a-91a2-c1532d8a1d0b-kube-api-access-ml6rc\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.222269 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.222140 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488a546e-d475-442a-91a2-c1532d8a1d0b-tmp\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.222269 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:02:53.222215 2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 30 21:02:53.222402 ip-10-0-133-49 kubenswrapper[2577]: E0730 21:02:53.222313 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs podName:488a546e-d475-442a-91a2-c1532d8a1d0b nodeName:}" failed. No retries permitted until 2026-07-30 21:02:53.722291551 +0000 UTC m=+331.819517326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs") pod "kube-auth-proxy-65ffdd497f-4xjf7" (UID: "488a546e-d475-442a-91a2-c1532d8a1d0b") : secret "kube-auth-proxy-tls" not found Jul 30 21:02:53.224292 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.224273 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/488a546e-d475-442a-91a2-c1532d8a1d0b-tmp\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.235975 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.235951 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6rc\" (UniqueName: \"kubernetes.io/projected/488a546e-d475-442a-91a2-c1532d8a1d0b-kube-api-access-ml6rc\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.725604 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.725564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.727931 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.727903 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/488a546e-d475-442a-91a2-c1532d8a1d0b-tls-certs\") pod \"kube-auth-proxy-65ffdd497f-4xjf7\" (UID: \"488a546e-d475-442a-91a2-c1532d8a1d0b\") " pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:53.999732 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:53.999698 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" Jul 30 21:02:54.133515 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:54.133490 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7"] Jul 30 21:02:54.135818 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:02:54.135784 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488a546e_d475_442a_91a2_c1532d8a1d0b.slice/crio-b6de506ea18c378673ac4a4e172656a5afb44f88c676e41c8569dfc34cdf4dab WatchSource:0}: Error finding container b6de506ea18c378673ac4a4e172656a5afb44f88c676e41c8569dfc34cdf4dab: Status 404 returned error can't find the container with id b6de506ea18c378673ac4a4e172656a5afb44f88c676e41c8569dfc34cdf4dab Jul 30 21:02:54.856227 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:54.856193 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" event={"ID":"488a546e-d475-442a-91a2-c1532d8a1d0b","Type":"ContainerStarted","Data":"b6de506ea18c378673ac4a4e172656a5afb44f88c676e41c8569dfc34cdf4dab"} Jul 30 21:02:57.872185 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:57.872146 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" event={"ID":"488a546e-d475-442a-91a2-c1532d8a1d0b","Type":"ContainerStarted","Data":"0f278bded08dfe1a125fe5cc826969110fc651595d7c90f575fcbc0124d3895e"} Jul 30 21:02:57.890127 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:02:57.890072 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65ffdd497f-4xjf7" podStartSLOduration=1.733736996 podStartE2EDuration="4.890056276s" totalImagesPullingTime="3.15631928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:02:57.888731901 +0000 UTC m=+335.985957715" watchObservedRunningTime="2026-07-30 21:02:57.890056276 +0000 UTC m=+335.987282069" Jul 30 21:04:15.612900 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.612860 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-drl49"] Jul 30 21:04:15.616244 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.616223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.619142 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.619061 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 30 21:04:15.619142 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.619061 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 30 21:04:15.619387 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.619370 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 30 21:04:15.620230 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.620215 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xrbsc\"" Jul 30 21:04:15.620317 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.620238 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 30 21:04:15.628091 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.628071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-drl49"] Jul 30 21:04:15.727527 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.727494 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19fdfccd-827f-4c28-8c4a-0e410f5a545f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.727703 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.727545 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbhwh\" (UniqueName: \"kubernetes.io/projected/19fdfccd-827f-4c28-8c4a-0e410f5a545f-kube-api-access-zbhwh\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.727703 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.727623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19fdfccd-827f-4c28-8c4a-0e410f5a545f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.828099 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.828065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19fdfccd-827f-4c28-8c4a-0e410f5a545f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.828301 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.828137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbhwh\" (UniqueName: \"kubernetes.io/projected/19fdfccd-827f-4c28-8c4a-0e410f5a545f-kube-api-access-zbhwh\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.828301 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.828193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19fdfccd-827f-4c28-8c4a-0e410f5a545f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.828799 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.828782 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/19fdfccd-827f-4c28-8c4a-0e410f5a545f-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.830634 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.830613 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/19fdfccd-827f-4c28-8c4a-0e410f5a545f-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.836883 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.836856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbhwh\" (UniqueName: \"kubernetes.io/projected/19fdfccd-827f-4c28-8c4a-0e410f5a545f-kube-api-access-zbhwh\") pod \"kuadrant-console-plugin-598f86468b-drl49\" (UID: \"19fdfccd-827f-4c28-8c4a-0e410f5a545f\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:15.940132 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:15.940030 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" Jul 30 21:04:16.068340 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:16.068320 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-drl49"] Jul 30 21:04:16.071294 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:04:16.071263 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19fdfccd_827f_4c28_8c4a_0e410f5a545f.slice/crio-4125619083c9fa27eef65db3be0eb5636715356e99e2ebf144318ed6056e4104 WatchSource:0}: Error finding container 4125619083c9fa27eef65db3be0eb5636715356e99e2ebf144318ed6056e4104: Status 404 returned error can't find the container with id 4125619083c9fa27eef65db3be0eb5636715356e99e2ebf144318ed6056e4104 Jul 30 21:04:16.213564 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:16.213483 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" event={"ID":"19fdfccd-827f-4c28-8c4a-0e410f5a545f","Type":"ContainerStarted","Data":"4125619083c9fa27eef65db3be0eb5636715356e99e2ebf144318ed6056e4104"} Jul 30 21:04:22.242511 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:22.242474 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" event={"ID":"19fdfccd-827f-4c28-8c4a-0e410f5a545f","Type":"ContainerStarted","Data":"c1d92a7e161c595299e3b94476eaab37a872ab59e11a1047a9d9f8778da62d70"} Jul 30 21:04:22.261302 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:22.261254 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-drl49" podStartSLOduration=1.269972372 podStartE2EDuration="7.261239536s" totalImagesPullingTime="5.991267164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:04:22.25888643 +0000 UTC m=+420.356112222" watchObservedRunningTime="2026-07-30 21:04:22.261239536 +0000 UTC m=+420.358465329" Jul 30 21:04:58.479273 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.479195 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:04:58.482530 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.482515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.485460 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.485438 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 30 21:04:58.493405 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.493385 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:04:58.506983 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.506964 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:04:58.593184 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.593160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-config-file\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.593283 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.593187 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r9pk\" (UniqueName: \"kubernetes.io/projected/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-kube-api-access-2r9pk\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.694055 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.694032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-config-file\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.694184 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.694059 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r9pk\" (UniqueName: \"kubernetes.io/projected/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-kube-api-access-2r9pk\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.694627 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.694609 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-config-file\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.702507 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.702490 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r9pk\" (UniqueName: \"kubernetes.io/projected/9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1-kube-api-access-2r9pk\") pod \"limitador-limitador-85d9db4d5d-cwxrc\" (UID: \"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.791955 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.791936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:04:58.917414 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:58.917310 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:04:58.920088 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:04:58.920063 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7eeebd_8dcf_4dbb_9e6e_fffb7a7ec8e1.slice/crio-715da897a2c5b6ce0e824e225d943fe92db0bb46429ce0f9bb38e0625c9923b1 WatchSource:0}: Error finding container 715da897a2c5b6ce0e824e225d943fe92db0bb46429ce0f9bb38e0625c9923b1: Status 404 returned error can't find the container with id 715da897a2c5b6ce0e824e225d943fe92db0bb46429ce0f9bb38e0625c9923b1 Jul 30 21:04:59.408413 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:04:59.408382 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" event={"ID":"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1","Type":"ContainerStarted","Data":"715da897a2c5b6ce0e824e225d943fe92db0bb46429ce0f9bb38e0625c9923b1"} Jul 30 21:05:02.422545 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:05:02.422514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" event={"ID":"9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1","Type":"ContainerStarted","Data":"e42d9258f0bf4cd5b29e292725c6b81b7f310d6b56bd3038362c7ddc113a7f48"} Jul 30 21:05:02.422911 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:05:02.422641 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:05:02.441627 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:05:02.441576 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" podStartSLOduration=1.962377534 podStartE2EDuration="4.441561775s" totalImagesPullingTime="2.479184241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:05:02.439556188 +0000 UTC m=+460.536781995" watchObservedRunningTime="2026-07-30 21:05:02.441561775 +0000 UTC m=+460.538787567" Jul 30 21:05:13.429032 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:05:13.429006 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc" Jul 30 21:06:16.961313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:06:16.961239 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:06:54.442623 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:06:54.442596 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:15.439757 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:15.439725 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:19.547514 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.547480 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm"] Jul 30 21:07:19.550844 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.550819 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.553786 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.553754 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 30 21:07:19.553914 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.553863 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 30 21:07:19.554912 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.554893 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 30 21:07:19.555023 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.554903 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9gzdm\"" Jul 30 21:07:19.561858 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.561832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm"] Jul 30 21:07:19.620539 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620513 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.620657 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620548 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b658d27-9877-4a27-be27-da1f29364ec0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.620657 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620570 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtvw\" (UniqueName: \"kubernetes.io/projected/1b658d27-9877-4a27-be27-da1f29364ec0-kube-api-access-zgtvw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.620657 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620649 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.620773 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620693 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.620773 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.620711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721142 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b658d27-9877-4a27-be27-da1f29364ec0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721150 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtvw\" (UniqueName: \"kubernetes.io/projected/1b658d27-9877-4a27-be27-da1f29364ec0-kube-api-access-zgtvw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721178 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721207 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721222 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721377 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721286 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721639 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721617 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721739 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721620 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.721739 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.721657 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.723348 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.723327 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b658d27-9877-4a27-be27-da1f29364ec0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.723581 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.723564 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b658d27-9877-4a27-be27-da1f29364ec0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.729590 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.729568 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtvw\" (UniqueName: \"kubernetes.io/projected/1b658d27-9877-4a27-be27-da1f29364ec0-kube-api-access-zgtvw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7wfwm\" (UID: \"1b658d27-9877-4a27-be27-da1f29364ec0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.863703 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.863642 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:19.994769 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:19.994749 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm"] Jul 30 21:07:19.996947 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:07:19.996924 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b658d27_9877_4a27_be27_da1f29364ec0.slice/crio-d134c2caceb8928fef186bd857070e3caa9e1811172ee0ce2a65b9499335a461 WatchSource:0}: Error finding container d134c2caceb8928fef186bd857070e3caa9e1811172ee0ce2a65b9499335a461: Status 404 returned error can't find the container with id d134c2caceb8928fef186bd857070e3caa9e1811172ee0ce2a65b9499335a461 Jul 30 21:07:20.024322 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:20.024292 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" event={"ID":"1b658d27-9877-4a27-be27-da1f29364ec0","Type":"ContainerStarted","Data":"d134c2caceb8928fef186bd857070e3caa9e1811172ee0ce2a65b9499335a461"} Jul 30 21:07:20.544902 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:20.544867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:22.035033 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:22.034994 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" event={"ID":"1b658d27-9877-4a27-be27-da1f29364ec0","Type":"ContainerStarted","Data":"81b295ea9362b9bee1d74a3a1efe6391a522bf21fc8732b0156a761b4594f2e4"} Jul 30 21:07:22.053323 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:22.053275 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" podStartSLOduration=1.988539255 podStartE2EDuration="3.053259447s" totalImagesPullingTime="1.064720192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:07:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:07:22.052296579 +0000 UTC m=+600.149522374" watchObservedRunningTime="2026-07-30 21:07:22.053259447 +0000 UTC m=+600.150485240" Jul 30 21:07:22.826879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:22.826778 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:07:22.840823 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:22.828809 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:07:29.864189 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:29.864155 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:29.864656 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:29.864209 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:29.876391 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:29.876367 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:30.082226 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:30.082193 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7wfwm" Jul 30 21:07:33.243798 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.243766 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx"] Jul 30 21:07:33.246996 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.246982 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.249916 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.249891 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 30 21:07:33.256130 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.256096 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx"] Jul 30 21:07:33.330781 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330759 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.330902 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330796 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flzxg\" (UniqueName: \"kubernetes.io/projected/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-kube-api-access-flzxg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.330902 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330877 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.330972 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330933 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.331006 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.331006 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.330997 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431297 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flzxg\" (UniqueName: \"kubernetes.io/projected/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-kube-api-access-flzxg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431434 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431316 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431434 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431434 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431373 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431434 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431391 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431434 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431766 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431747 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431825 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431803 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.431825 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.431818 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.433566 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.433549 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.433954 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.433935 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.439968 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.439947 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flzxg\" (UniqueName: \"kubernetes.io/projected/d53283fd-0e89-4ac8-b02d-72f75fc60f5f-kube-api-access-flzxg\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx\" (UID: \"d53283fd-0e89-4ac8-b02d-72f75fc60f5f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.556946 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.556865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:33.686050 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.686027 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx"] Jul 30 21:07:33.687777 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:07:33.687747 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53283fd_0e89_4ac8_b02d_72f75fc60f5f.slice/crio-24c4296dc898a9ba7fc5601116083e71411383783d26c9a779f0dd50a951298c WatchSource:0}: Error finding container 24c4296dc898a9ba7fc5601116083e71411383783d26c9a779f0dd50a951298c: Status 404 returned error can't find the container with id 24c4296dc898a9ba7fc5601116083e71411383783d26c9a779f0dd50a951298c Jul 30 21:07:33.689244 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:33.689226 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 21:07:34.090663 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:34.090629 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" event={"ID":"d53283fd-0e89-4ac8-b02d-72f75fc60f5f","Type":"ContainerStarted","Data":"b86e82de2a0b29e05fdb88ca76a0ed8969487dbb7cf80e348da97647494d378b"} Jul 30 21:07:34.090827 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:34.090677 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" event={"ID":"d53283fd-0e89-4ac8-b02d-72f75fc60f5f","Type":"ContainerStarted","Data":"24c4296dc898a9ba7fc5601116083e71411383783d26c9a779f0dd50a951298c"} Jul 30 21:07:34.108391 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:34.108348 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" podStartSLOduration=0.908600946 podStartE2EDuration="1.108334078s" totalImagesPullingTime="199.733132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:07:34.107673598 +0000 UTC m=+612.204899410" watchObservedRunningTime="2026-07-30 21:07:34.108334078 +0000 UTC m=+612.205559871" Jul 30 21:07:34.541677 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:34.541645 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:43.557495 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:43.557447 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:43.557882 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:43.557525 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:43.569938 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:43.569910 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:44.156384 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:44.156350 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx" Jul 30 21:07:45.441777 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.441707 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2"] Jul 30 21:07:45.447432 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.447409 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.450005 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.449975 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 30 21:07:45.456165 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.456107 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2"] Jul 30 21:07:45.638705 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638663 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.638705 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638704 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.638920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.638920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638801 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e36c005-57ac-46df-b137-666f0c4b6c43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.638920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwh65\" (UniqueName: \"kubernetes.io/projected/5e36c005-57ac-46df-b137-666f0c4b6c43-kube-api-access-wwh65\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.638920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.638875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739364 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739562 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739371 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e36c005-57ac-46df-b137-666f0c4b6c43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739562 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739390 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwh65\" (UniqueName: \"kubernetes.io/projected/5e36c005-57ac-46df-b137-666f0c4b6c43-kube-api-access-wwh65\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739562 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739427 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739562 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739481 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739562 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739498 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739870 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739850 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739928 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739877 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.739963 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.739925 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.741722 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.741701 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5e36c005-57ac-46df-b137-666f0c4b6c43-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.741988 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.741970 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5e36c005-57ac-46df-b137-666f0c4b6c43-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.750454 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.750433 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwh65\" (UniqueName: \"kubernetes.io/projected/5e36c005-57ac-46df-b137-666f0c4b6c43-kube-api-access-wwh65\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-x65z2\" (UID: \"5e36c005-57ac-46df-b137-666f0c4b6c43\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.759421 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.759397 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:45.899534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:45.899504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2"] Jul 30 21:07:45.901578 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:07:45.901555 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e36c005_57ac_46df_b137_666f0c4b6c43.slice/crio-b3b4e8f0e174ab07df46ce9f36961a8bcf7e9edab1bc824def7d897c213cec9f WatchSource:0}: Error finding container b3b4e8f0e174ab07df46ce9f36961a8bcf7e9edab1bc824def7d897c213cec9f: Status 404 returned error can't find the container with id b3b4e8f0e174ab07df46ce9f36961a8bcf7e9edab1bc824def7d897c213cec9f Jul 30 21:07:46.155128 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:46.155090 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" event={"ID":"5e36c005-57ac-46df-b137-666f0c4b6c43","Type":"ContainerStarted","Data":"b3b4e8f0e174ab07df46ce9f36961a8bcf7e9edab1bc824def7d897c213cec9f"} Jul 30 21:07:47.164457 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:47.164414 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" event={"ID":"5e36c005-57ac-46df-b137-666f0c4b6c43","Type":"ContainerStarted","Data":"a749a42e2d410854b0ff15e6444a6071819a6e4e2626a8582bdd4a454870b107"} Jul 30 21:07:47.185737 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:47.185683 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" podStartSLOduration=1.9627509920000001 podStartE2EDuration="2.185665881s" totalImagesPullingTime="222.914889ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:07:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:07:47.182964596 +0000 UTC m=+625.280190389" watchObservedRunningTime="2026-07-30 21:07:47.185665881 +0000 UTC m=+625.282891674" Jul 30 21:07:47.744506 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:47.744474 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:48.850056 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.850021 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2"] Jul 30 21:07:48.853336 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.853322 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.855914 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.855896 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 30 21:07:48.861083 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861062 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.861217 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.861217 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861203 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvxj9\" (UniqueName: \"kubernetes.io/projected/67f9f031-b433-46c8-8f4d-ade3e759f1cb-kube-api-access-vvxj9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.861333 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861243 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.861333 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.861333 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.861308 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.863361 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.863343 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2"] Jul 30 21:07:48.962264 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962264 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxj9\" (UniqueName: \"kubernetes.io/projected/67f9f031-b433-46c8-8f4d-ade3e759f1cb-kube-api-access-vvxj9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962339 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962388 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962754 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962711 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962835 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962812 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.962835 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.962828 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.964587 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.964566 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67f9f031-b433-46c8-8f4d-ade3e759f1cb-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.964868 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.964848 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f9f031-b433-46c8-8f4d-ade3e759f1cb-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:48.970422 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:48.970400 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvxj9\" (UniqueName: \"kubernetes.io/projected/67f9f031-b433-46c8-8f4d-ade3e759f1cb-kube-api-access-vvxj9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2\" (UID: \"67f9f031-b433-46c8-8f4d-ade3e759f1cb\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:49.162841 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:49.162747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:49.296436 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:49.296403 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2"] Jul 30 21:07:49.299768 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:07:49.299737 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67f9f031_b433_46c8_8f4d_ade3e759f1cb.slice/crio-47ba5156af5fe14b72d849d7242f785f2a392b834cf97a9af9fed0776ee7ccc7 WatchSource:0}: Error finding container 47ba5156af5fe14b72d849d7242f785f2a392b834cf97a9af9fed0776ee7ccc7: Status 404 returned error can't find the container with id 47ba5156af5fe14b72d849d7242f785f2a392b834cf97a9af9fed0776ee7ccc7 Jul 30 21:07:50.180308 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:50.180276 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" event={"ID":"67f9f031-b433-46c8-8f4d-ade3e759f1cb","Type":"ContainerStarted","Data":"2908dc843dc81e7282c3c259582d7dc326630471bc7a2fd464aee0e9352354c6"} Jul 30 21:07:50.180712 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:50.180317 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" event={"ID":"67f9f031-b433-46c8-8f4d-ade3e759f1cb","Type":"ContainerStarted","Data":"47ba5156af5fe14b72d849d7242f785f2a392b834cf97a9af9fed0776ee7ccc7"} Jul 30 21:07:50.198495 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:50.198295 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" podStartSLOduration=2.012014428 podStartE2EDuration="2.198280283s" totalImagesPullingTime="186.265855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:07:50.198236031 +0000 UTC m=+628.295461828" watchObservedRunningTime="2026-07-30 21:07:50.198280283 +0000 UTC m=+628.295506058" Jul 30 21:07:55.759620 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:55.759588 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:55.760038 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:55.759664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:55.772125 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:55.772089 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:56.218668 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:56.218594 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-x65z2" Jul 30 21:07:57.342454 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:57.342419 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:07:59.163771 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:59.163742 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:59.164159 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:59.163785 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:59.176456 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:59.176433 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:07:59.231849 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:07:59.231828 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2" Jul 30 21:09:23.653941 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:09:23.653862 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:09:33.942574 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:09:33.942536 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:09:45.340245 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:09:45.340212 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:11:27.743228 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:11:27.743189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:11:37.848089 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:11:37.848054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:12:22.855711 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:12:22.855612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:12:22.860940 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:12:22.859276 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:12:35.561798 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:12:35.561767 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:12:42.638736 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:12:42.638690 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:12:57.641623 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:12:57.641593 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:04.369134 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:04.359176 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:13.546257 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:13.546226 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:21.145924 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:21.145894 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:33.653934 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:33.653902 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:38.842445 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:38.842412 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:13:44.047534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:13:44.047459 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:14:05.759154 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:14:05.759123 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:14:16.443380 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:14:16.443341 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:14:39.047903 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:14:39.047867 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:14:49.249321 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:14:49.249289 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:14:55.049498 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:14:55.049458 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:03.849439 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:03.849403 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:14.549156 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:14.549056 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:21.043064 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:21.043028 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:27.649870 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:27.649836 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:44.239274 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:44.239240 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:50.554673 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:50.554636 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:15:59.841082 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:15:59.841045 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:16:08.552087 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:16:08.552054 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:16:19.449271 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:16:19.449237 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:16:24.745702 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:16:24.745668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:16:35.442992 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:16:35.442955 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:17:22.884716 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:17:22.884619 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:17:22.890144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:17:22.890126 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:18:51.841318 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:18:51.841285 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:18:57.244316 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:18:57.244284 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:19:21.648763 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:19:21.648727 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:19:32.846211 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:19:32.846172 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:19:43.454682 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:19:43.454650 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:19:48.351473 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:19:48.351437 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:19:53.347289 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:19:53.347254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:03.349413 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:03.349384 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:08.346160 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:08.346129 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:18.442277 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:18.442247 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:23.446836 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:23.446802 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:33.652489 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:33.652453 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:40.245631 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:40.245598 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:20:50.742266 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:20:50.742227 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:21:13.646229 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:21:13.646189 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:21:20.438818 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:21:20.438782 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:21:43.948921 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:21:43.948885 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:21:56.045774 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:21:56.045742 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:22:19.946805 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:19.946765 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:22:22.914266 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:22.914155 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:22:22.920953 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:22.920936 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:22:30.938243 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:30.938209 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:22:36.751394 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:36.751361 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:22:43.447543 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:43.447508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:22:53.743734 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:22:53.743691 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:00.243547 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:00.243508 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:07.846048 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:07.846015 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:16.044755 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:16.044721 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:25.940848 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:25.940813 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:32.647105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:32.647071 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:48.648108 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:48.648076 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:23:55.638898 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:23:55.638870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:07.149971 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:07.149941 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:14.348861 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:14.348789 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:20.840996 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:20.840962 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:25.746225 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:25.746194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:32.242860 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:32.242828 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:42.745230 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:42.745196 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:24:49.640075 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:24:49.640045 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:00.138073 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:00.138041 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:06.445835 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:06.445803 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:17.150048 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:17.150011 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:32.447547 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:32.447511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:38.546656 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:38.546624 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:44.245159 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:44.245066 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:25:56.442247 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:25:56.442206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:26:04.744782 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:26:04.744749 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:26:10.640630 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:26:10.640588 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:26:24.949100 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:26:24.949063 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:27:05.247467 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:05.247434 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:27:13.933697 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:13.933621 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:27:22.943615 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:22.943509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:27:22.951328 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:22.950960 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:27:38.942567 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:38.942528 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:27:47.642559 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:27:47.642529 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:28:24.540733 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:28:24.540698 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:28:33.245497 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:28:33.245461 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:29:00.745480 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:29:00.745396 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:29:12.046459 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:29:12.046426 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:30:41.649617 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:30:41.649579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:30:51.441486 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:30:51.441452 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:31:04.643203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:31:04.643167 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:31:46.437445 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:31:46.437361 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:32:22.972011 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:32:22.971903 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:32:22.982410 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:32:22.982392 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:32:24.940129 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:32:24.940084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:34:12.651546 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:34:12.651513 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:34:21.741081 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:34:21.741049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:34:52.149420 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:34:52.149345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:35:06.848313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:35:06.848281 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:35:30.437547 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:35:30.437514 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:35:36.238216 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:35:36.238178 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:36:26.349751 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:36:26.349669 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:36:38.550417 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:36:38.550385 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:36:51.243275 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:36:51.243241 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:37:23.005798 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:37:23.005770 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:37:23.016699 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:37:23.016680 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:37:36.649164 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:37:36.649124 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:38:04.840083 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:38:04.840005 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:38:36.039999 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:38:36.039961 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:38:44.738098 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:38:44.738065 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:39:16.548996 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:39:16.548914 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:40:04.539347 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:40:04.539312 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:40:14.942954 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:40:14.942921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:40:32.447912 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:40:32.447881 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:40:45.837473 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:40:45.837394 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:41:15.440438 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:41:15.440405 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:41:55.745396 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:41:55.745359 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:42:17.742640 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:42:17.742568 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:42:23.034694 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:42:23.034582 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:42:23.046261 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:42:23.046242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:42:30.546740 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:42:30.546707 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:42:58.843855 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:42:58.843814 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:43:48.750733 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:43:48.750656 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:44:11.940140 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:44:11.940095 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:44:34.843773 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:44:34.843737 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:44:50.242863 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:44:50.242829 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:45:00.139993 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.139957 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5"] Jul 30 21:45:00.143450 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.143432 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" Jul 30 21:45:00.146288 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.146268 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pwwf4\"" Jul 30 21:45:00.154574 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.154465 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" Jul 30 21:45:00.155073 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.155049 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5"] Jul 30 21:45:00.292454 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.292417 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5"] Jul 30 21:45:00.295329 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:45:00.295287 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0be1ac1_f9d9_45b5_bf47_194c8fca9c27.slice/crio-7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468 WatchSource:0}: Error finding container 7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468: Status 404 returned error can't find the container with id 7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468 Jul 30 21:45:00.301406 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.301388 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 30 21:45:00.471133 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:00.471040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" event={"ID":"a0be1ac1-f9d9-45b5-bf47-194c8fca9c27","Type":"ContainerStarted","Data":"7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468"} Jul 30 21:45:01.640652 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:01.640613 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:45:03.490052 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:03.490022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" event={"ID":"a0be1ac1-f9d9-45b5-bf47-194c8fca9c27","Type":"ContainerStarted","Data":"eeb77464f4148602501bacecc4387c7a799b339602fda274bebb6694f36b7725"} Jul 30 21:45:03.505516 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:03.505466 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" podStartSLOduration=1.19972528 podStartE2EDuration="3.505449477s" totalImagesPullingTime="2.305724197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:45:03.50406077 +0000 UTC m=+2861.601286563" watchObservedRunningTime="2026-07-30 21:45:03.505449477 +0000 UTC m=+2861.602675299" Jul 30 21:45:04.496617 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:04.496582 2577 generic.go:356] "Generic (PLEG): container finished" podID="a0be1ac1-f9d9-45b5-bf47-194c8fca9c27" containerID="eeb77464f4148602501bacecc4387c7a799b339602fda274bebb6694f36b7725" exitCode=0 Jul 30 21:45:04.497034 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:04.496674 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" event={"ID":"a0be1ac1-f9d9-45b5-bf47-194c8fca9c27","Type":"ContainerDied","Data":"eeb77464f4148602501bacecc4387c7a799b339602fda274bebb6694f36b7725"} Jul 30 21:45:05.642536 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:05.642513 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" Jul 30 21:45:06.513380 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:06.513355 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" Jul 30 21:45:06.513551 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:06.513347 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5" event={"ID":"a0be1ac1-f9d9-45b5-bf47-194c8fca9c27","Type":"ContainerDied","Data":"7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468"} Jul 30 21:45:06.513551 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:06.513474 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ef85c50a03c0c915b8ae415bdb630835435b7ed3dbce25378302298585cd468" Jul 30 21:45:16.739036 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:16.738953 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:45:32.248426 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:32.248389 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:45:42.742647 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:42.742608 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:45:58.546106 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:45:58.546070 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:46:14.145232 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:46:14.145193 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:46:25.643683 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:46:25.643645 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:46:40.638879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:46:40.638845 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:46:57.041012 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:46:57.040942 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:47:07.840131 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:07.840090 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:47:23.062534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:23.062425 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:47:23.076792 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:23.076772 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:47:23.243596 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:23.243567 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:47:39.042107 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:39.042072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:47:50.243207 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:47:50.243173 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:48:05.639705 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:48:05.639671 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:48:20.936339 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:48:20.936259 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:48:31.037362 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:48:31.037326 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:48:44.048695 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:48:44.048663 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:49:14.943996 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:49:14.943962 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:49:53.735717 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:49:53.735642 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:50:04.548901 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:04.548863 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:50:32.047013 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:32.046983 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:50:43.748332 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:43.748296 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:50:47.946608 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.946572 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:50:47.946957 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.946920 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be1ac1-f9d9-45b5-bf47-194c8fca9c27" containerName="cleanup" Jul 30 21:50:47.946957 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.946931 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be1ac1-f9d9-45b5-bf47-194c8fca9c27" containerName="cleanup" Jul 30 21:50:47.947032 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.947007 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0be1ac1-f9d9-45b5-bf47-194c8fca9c27" containerName="cleanup" Jul 30 21:50:47.950217 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.950196 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.954191 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.954165 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2abe52\"/\"rate-test-model-2abe52-kserve-self-signed-certs\"" Jul 30 21:50:47.954302 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.954172 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2abe52\"/\"kube-root-ca.crt\"" Jul 30 21:50:47.954302 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.954172 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-2abe52\"/\"default-dockercfg-s9rlm\"" Jul 30 21:50:47.954302 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.954296 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-2abe52\"/\"openshift-service-ca.crt\"" Jul 30 21:50:47.959568 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.959549 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:50:47.974299 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974271 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.974299 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.974472 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974315 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4cl\" (UniqueName: \"kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.974472 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.974472 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974464 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:47.974643 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:47.974511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075542 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075544 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4cl\" (UniqueName: \"kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075650 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075800 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075666 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075800 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075913 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075900 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.075975 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.075938 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.076031 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.076005 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.077883 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.077856 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.078106 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.078086 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.084905 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.084888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4cl\" (UniqueName: \"kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl\") pod \"rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.259900 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.259875 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:48.388938 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:48.388916 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:50:48.390423 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:50:48.390396 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6179bd3e_9898_4108_83ad_661bd38126f0.slice/crio-efed979be194d12f6b3de7a1929a568e4489a67e974f5e957ea75e251ffdd216 WatchSource:0}: Error finding container efed979be194d12f6b3de7a1929a568e4489a67e974f5e957ea75e251ffdd216: Status 404 returned error can't find the container with id efed979be194d12f6b3de7a1929a568e4489a67e974f5e957ea75e251ffdd216 Jul 30 21:50:49.100854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:49.100819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" event={"ID":"6179bd3e-9898-4108-83ad-661bd38126f0","Type":"ContainerStarted","Data":"fb8fb47613b1dc26658a90b3b83f84ecc0704e6e61767c530b02800a7d8e54ee"} Jul 30 21:50:49.100854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:49.100863 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" event={"ID":"6179bd3e-9898-4108-83ad-661bd38126f0","Type":"ContainerStarted","Data":"efed979be194d12f6b3de7a1929a568e4489a67e974f5e957ea75e251ffdd216"} Jul 30 21:50:49.116720 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:49.116671 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" podStartSLOduration=2.116653668 podStartE2EDuration="2.116653668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:50:49.116144815 +0000 UTC m=+3207.213370628" watchObservedRunningTime="2026-07-30 21:50:49.116653668 +0000 UTC m=+3207.213879459" Jul 30 21:50:49.944715 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:49.944681 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:50:58.260123 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:58.260089 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:58.260540 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:58.260184 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:58.272641 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:58.272613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:50:59.157512 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:50:59.157484 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:51:07.946534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:51:07.946502 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:51:44.545346 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:51:44.545314 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:51:53.047658 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:51:53.047622 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:52:09.040896 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:09.040864 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:52:14.316880 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:14.316841 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:52:18.054675 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:18.054638 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:52:23.093609 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:23.093501 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:52:23.108200 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:23.108181 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:52:29.337449 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.337397 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" podUID="6179bd3e-9898-4108-83ad-661bd38126f0" containerName="main" containerID="cri-o://fb8fb47613b1dc26658a90b3b83f84ecc0704e6e61767c530b02800a7d8e54ee" gracePeriod=45 Jul 30 21:52:29.570381 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.570347 2577 generic.go:356] "Generic (PLEG): container finished" podID="6179bd3e-9898-4108-83ad-661bd38126f0" containerID="fb8fb47613b1dc26658a90b3b83f84ecc0704e6e61767c530b02800a7d8e54ee" exitCode=0 Jul 30 21:52:29.570538 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.570429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" event={"ID":"6179bd3e-9898-4108-83ad-661bd38126f0","Type":"ContainerDied","Data":"fb8fb47613b1dc26658a90b3b83f84ecc0704e6e61767c530b02800a7d8e54ee"} Jul 30 21:52:29.587979 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.587931 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:52:29.635338 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635309 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635464 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635343 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635464 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635366 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635464 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635419 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635464 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635433 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635671 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635473 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz4cl\" (UniqueName: \"kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl\") pod \"6179bd3e-9898-4108-83ad-661bd38126f0\" (UID: \"6179bd3e-9898-4108-83ad-661bd38126f0\") " Jul 30 21:52:29.635725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635702 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home" (OuterVolumeSpecName: "home") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:52:29.635783 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635723 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache" (OuterVolumeSpecName: "model-cache") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:52:29.635783 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635708 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:52:29.635877 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635814 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-model-cache\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:29.635877 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635831 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-home\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:29.635877 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.635844 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-tmp-dir\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:29.637553 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.637526 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:52:29.637654 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.637561 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm" (OuterVolumeSpecName: "dshm") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:52:29.637654 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.637588 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl" (OuterVolumeSpecName: "kube-api-access-mz4cl") pod "6179bd3e-9898-4108-83ad-661bd38126f0" (UID: "6179bd3e-9898-4108-83ad-661bd38126f0"). InnerVolumeSpecName "kube-api-access-mz4cl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:52:29.737097 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.737066 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz4cl\" (UniqueName: \"kubernetes.io/projected/6179bd3e-9898-4108-83ad-661bd38126f0-kube-api-access-mz4cl\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:29.737097 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.737091 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6179bd3e-9898-4108-83ad-661bd38126f0-tls-certs\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:29.737097 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:29.737103 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6179bd3e-9898-4108-83ad-661bd38126f0-dshm\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:52:30.575487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:30.575457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" event={"ID":"6179bd3e-9898-4108-83ad-661bd38126f0","Type":"ContainerDied","Data":"efed979be194d12f6b3de7a1929a568e4489a67e974f5e957ea75e251ffdd216"} Jul 30 21:52:30.575487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:30.575485 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb" Jul 30 21:52:30.575939 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:30.575504 2577 scope.go:117] "RemoveContainer" containerID="fb8fb47613b1dc26658a90b3b83f84ecc0704e6e61767c530b02800a7d8e54ee" Jul 30 21:52:30.592886 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:30.592862 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:52:30.596638 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:30.596617 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-2abe52/rate-test-model-2abe52-kserve-5b5fc6df67-hl2mb"] Jul 30 21:52:32.410087 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:32.410056 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6179bd3e-9898-4108-83ad-661bd38126f0" path="/var/lib/kubelet/pods/6179bd3e-9898-4108-83ad-661bd38126f0/volumes" Jul 30 21:52:42.548950 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:52:42.548909 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:53:11.945597 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:11.945561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:53:51.954357 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.954323 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:53:51.954897 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.954715 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6179bd3e-9898-4108-83ad-661bd38126f0" containerName="main" Jul 30 21:53:51.954897 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.954727 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6179bd3e-9898-4108-83ad-661bd38126f0" containerName="main" Jul 30 21:53:51.954897 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.954798 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6179bd3e-9898-4108-83ad-661bd38126f0" containerName="main" Jul 30 21:53:51.958028 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.958009 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:51.961841 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.961814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-df94bf\"/\"ipp-route-df94bf-kserve-self-signed-certs\"" Jul 30 21:53:51.961971 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.961844 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-df94bf\"/\"openshift-service-ca.crt\"" Jul 30 21:53:51.961971 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.961814 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-df94bf\"/\"default-dockercfg-kpmqx\"" Jul 30 21:53:51.961971 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.961915 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-df94bf\"/\"kube-root-ca.crt\"" Jul 30 21:53:51.966805 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:51.966433 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:53:52.057974 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.057926 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.058191 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.057983 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.058191 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.058007 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgn2c\" (UniqueName: \"kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.058191 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.058056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.058191 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.058080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.058357 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.058223 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159398 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159612 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159413 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159612 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159450 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159612 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgn2c\" (UniqueName: \"kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159612 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159612 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159527 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159887 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.159983 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159966 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.160041 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.159986 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.161791 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.161769 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.162005 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.161988 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.167809 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.167784 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgn2c\" (UniqueName: \"kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c\") pod \"ipp-route-df94bf-kserve-55cb69bf79-fblfg\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.270091 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.270051 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:53:52.405870 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:53:52.405842 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5900c5db_d02c_4333_82f9_affc25a4c49d.slice/crio-a02866840e1ff7ae28f6f2ece6cdbac8432a3aaa1adb0efde3d1f56b1273af84 WatchSource:0}: Error finding container a02866840e1ff7ae28f6f2ece6cdbac8432a3aaa1adb0efde3d1f56b1273af84: Status 404 returned error can't find the container with id a02866840e1ff7ae28f6f2ece6cdbac8432a3aaa1adb0efde3d1f56b1273af84 Jul 30 21:53:52.410105 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.410083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:53:52.961935 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.961899 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" event={"ID":"5900c5db-d02c-4333-82f9-affc25a4c49d","Type":"ContainerStarted","Data":"41f51e05a9f7cf884a371a917bdfc771671b5768b351e056400b349b8f2e2693"} Jul 30 21:53:52.962420 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.961946 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" event={"ID":"5900c5db-d02c-4333-82f9-affc25a4c49d","Type":"ContainerStarted","Data":"a02866840e1ff7ae28f6f2ece6cdbac8432a3aaa1adb0efde3d1f56b1273af84"} Jul 30 21:53:52.978485 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:52.978439 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" podStartSLOduration=1.978424579 podStartE2EDuration="1.978424579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:53:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:53:52.977617167 +0000 UTC m=+3391.074842986" watchObservedRunningTime="2026-07-30 21:53:52.978424579 +0000 UTC m=+3391.075650371" Jul 30 21:53:53.743981 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:53:53.743946 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:54:02.270543 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:02.270514 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:54:02.270916 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:02.270554 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:54:02.282807 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:02.282783 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:54:03.020725 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:03.020691 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:54:17.548937 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:17.548858 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:54:38.537879 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:38.537843 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:54:58.008559 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.008529 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg"] Jul 30 21:54:58.012175 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.012160 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:54:58.014778 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.014757 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pwwf4\"" Jul 30 21:54:58.014897 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.014798 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 21:54:58.018691 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.018664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg"] Jul 30 21:54:58.103949 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.103921 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg\" (UID: \"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:54:58.204826 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.204793 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg\" (UID: \"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:54:58.205483 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.205466 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg\" (UID: \"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:54:58.323854 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.323779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:54:58.452472 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:58.452445 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg"] Jul 30 21:54:58.454406 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:54:58.454368 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fa8399_c72a_41f0_b7a9_d20eb28a5a3a.slice/crio-98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255 WatchSource:0}: Error finding container 98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255: Status 404 returned error can't find the container with id 98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255 Jul 30 21:54:59.291973 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:59.291942 2577 generic.go:356] "Generic (PLEG): container finished" podID="f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" containerID="d0e50c93f03f33c45246af053966318642a3c5b3cd4cc13c2a51d005cdd477ab" exitCode=0 Jul 30 21:54:59.292362 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:59.292032 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" event={"ID":"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a","Type":"ContainerDied","Data":"d0e50c93f03f33c45246af053966318642a3c5b3cd4cc13c2a51d005cdd477ab"} Jul 30 21:54:59.292362 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:54:59.292102 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" event={"ID":"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a","Type":"ContainerStarted","Data":"98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255"} Jul 30 21:55:00.427047 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:00.427025 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:55:00.524649 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:00.524614 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca\") pod \"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a\" (UID: \"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a\") " Jul 30 21:55:00.524976 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:00.524954 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" (UID: "f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:55:00.625769 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:00.625685 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a-maas-api-service-ca\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:01.302940 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:01.302908 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" event={"ID":"f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a","Type":"ContainerDied","Data":"98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255"} Jul 30 21:55:01.302940 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:01.302939 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg" Jul 30 21:55:01.303154 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:01.302953 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="98d978539e2d5aef688f18065ab81a431dc7319ebd4efac3c69b5be23003d255" Jul 30 21:55:04.207231 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:04.207194 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg"] Jul 30 21:55:04.209539 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:04.209515 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-7d83c0-lz8gg"] Jul 30 21:55:04.409066 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:04.409034 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" path="/var/lib/kubelet/pods/f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a/volumes" Jul 30 21:55:07.337779 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:07.337739 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:55:14.378923 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.378888 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh"] Jul 30 21:55:14.379479 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.379459 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" containerName="revoke-keys" Jul 30 21:55:14.379563 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.379481 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" containerName="revoke-keys" Jul 30 21:55:14.379624 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.379597 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4fa8399-c72a-41f0-b7a9-d20eb28a5a3a" containerName="revoke-keys" Jul 30 21:55:14.382737 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.382717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:14.385349 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.385330 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pwwf4\"" Jul 30 21:55:14.385453 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.385374 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 21:55:14.389863 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.389839 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh"] Jul 30 21:55:14.443516 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.443490 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh\" (UID: \"855e20d6-9633-4ce6-b726-5dc97ade5fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:14.544715 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.544688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh\" (UID: \"855e20d6-9633-4ce6-b726-5dc97ade5fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:14.545252 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.545236 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh\" (UID: \"855e20d6-9633-4ce6-b726-5dc97ade5fa3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:14.694593 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:14.694536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:15.029280 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:15.029254 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh"] Jul 30 21:55:15.031158 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:55:15.031131 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod855e20d6_9633_4ce6_b726_5dc97ade5fa3.slice/crio-1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a WatchSource:0}: Error finding container 1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a: Status 404 returned error can't find the container with id 1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a Jul 30 21:55:15.371333 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:15.371264 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" event={"ID":"855e20d6-9633-4ce6-b726-5dc97ade5fa3","Type":"ContainerStarted","Data":"d22ab7c223bd91742d8e45b89cf687f1da521e654df3018aaf287b741a4c4b65"} Jul 30 21:55:15.371333 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:15.371320 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" event={"ID":"855e20d6-9633-4ce6-b726-5dc97ade5fa3","Type":"ContainerStarted","Data":"1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a"} Jul 30 21:55:15.386107 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:15.386059 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" podStartSLOduration=1.386045696 podStartE2EDuration="1.386045696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 21:55:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:55:15.385245583 +0000 UTC m=+3473.482471397" watchObservedRunningTime="2026-07-30 21:55:15.386045696 +0000 UTC m=+3473.483271488" Jul 30 21:55:16.377433 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:16.377398 2577 generic.go:356] "Generic (PLEG): container finished" podID="855e20d6-9633-4ce6-b726-5dc97ade5fa3" containerID="d22ab7c223bd91742d8e45b89cf687f1da521e654df3018aaf287b741a4c4b65" exitCode=0 Jul 30 21:55:16.377605 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:16.377495 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" event={"ID":"855e20d6-9633-4ce6-b726-5dc97ade5fa3","Type":"ContainerDied","Data":"d22ab7c223bd91742d8e45b89cf687f1da521e654df3018aaf287b741a4c4b65"} Jul 30 21:55:17.512980 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:17.512953 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:17.572161 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:17.572131 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca\") pod \"855e20d6-9633-4ce6-b726-5dc97ade5fa3\" (UID: \"855e20d6-9633-4ce6-b726-5dc97ade5fa3\") " Jul 30 21:55:17.572477 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:17.572452 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "855e20d6-9633-4ce6-b726-5dc97ade5fa3" (UID: "855e20d6-9633-4ce6-b726-5dc97ade5fa3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:55:17.672990 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:17.672914 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/855e20d6-9633-4ce6-b726-5dc97ade5fa3-maas-api-service-ca\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:18.388856 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:18.388826 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" Jul 30 21:55:18.389086 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:18.388871 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh" event={"ID":"855e20d6-9633-4ce6-b726-5dc97ade5fa3","Type":"ContainerDied","Data":"1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a"} Jul 30 21:55:18.389086 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:18.388938 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1bd50513691601d47f668902a33078f0c73615bdfac10fcf6ac9a657bacda34a" Jul 30 21:55:27.839484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:27.839446 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:55:30.020462 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:30.020428 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh"] Jul 30 21:55:30.022775 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:30.022745 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-df94bf-d8mmh"] Jul 30 21:55:30.410385 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:30.410315 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="855e20d6-9633-4ce6-b726-5dc97ade5fa3" path="/var/lib/kubelet/pods/855e20d6-9633-4ce6-b726-5dc97ade5fa3/volumes" Jul 30 21:55:35.399918 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:35.399885 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:55:37.241575 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:37.241543 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:55:50.419144 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.419096 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" podUID="5900c5db-d02c-4333-82f9-affc25a4c49d" containerName="main" containerID="cri-o://41f51e05a9f7cf884a371a917bdfc771671b5768b351e056400b349b8f2e2693" gracePeriod=45 Jul 30 21:55:50.554664 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.554637 2577 generic.go:356] "Generic (PLEG): container finished" podID="5900c5db-d02c-4333-82f9-affc25a4c49d" containerID="41f51e05a9f7cf884a371a917bdfc771671b5768b351e056400b349b8f2e2693" exitCode=0 Jul 30 21:55:50.554817 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.554714 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" event={"ID":"5900c5db-d02c-4333-82f9-affc25a4c49d","Type":"ContainerDied","Data":"41f51e05a9f7cf884a371a917bdfc771671b5768b351e056400b349b8f2e2693"} Jul 30 21:55:50.670530 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.670477 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:55:50.751313 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751291 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751469 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751333 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751469 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751418 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751469 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751445 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751645 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751472 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751645 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751491 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgn2c\" (UniqueName: \"kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c\") pod \"5900c5db-d02c-4333-82f9-affc25a4c49d\" (UID: \"5900c5db-d02c-4333-82f9-affc25a4c49d\") " Jul 30 21:55:50.751645 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751517 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:55:50.751787 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751649 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:55:50.751787 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751719 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home" (OuterVolumeSpecName: "home") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:55:50.751865 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751846 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-home\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:50.751899 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751865 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-tmp-dir\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:50.751899 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.751879 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-model-cache\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:50.753592 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.753564 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm" (OuterVolumeSpecName: "dshm") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 30 21:55:50.753592 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.753578 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 30 21:55:50.753592 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.753578 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c" (OuterVolumeSpecName: "kube-api-access-zgn2c") pod "5900c5db-d02c-4333-82f9-affc25a4c49d" (UID: "5900c5db-d02c-4333-82f9-affc25a4c49d"). InnerVolumeSpecName "kube-api-access-zgn2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 30 21:55:50.853071 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.853046 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5900c5db-d02c-4333-82f9-affc25a4c49d-dshm\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:50.853071 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.853068 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5900c5db-d02c-4333-82f9-affc25a4c49d-tls-certs\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:50.853227 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:50.853079 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgn2c\" (UniqueName: \"kubernetes.io/projected/5900c5db-d02c-4333-82f9-affc25a4c49d-kube-api-access-zgn2c\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:55:51.567001 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:51.566971 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" Jul 30 21:55:51.567416 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:51.567001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg" event={"ID":"5900c5db-d02c-4333-82f9-affc25a4c49d","Type":"ContainerDied","Data":"a02866840e1ff7ae28f6f2ece6cdbac8432a3aaa1adb0efde3d1f56b1273af84"} Jul 30 21:55:51.567416 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:51.567065 2577 scope.go:117] "RemoveContainer" containerID="41f51e05a9f7cf884a371a917bdfc771671b5768b351e056400b349b8f2e2693" Jul 30 21:55:51.588628 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:51.588606 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:55:51.592134 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:51.592101 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-df94bf/ipp-route-df94bf-kserve-55cb69bf79-fblfg"] Jul 30 21:55:52.411161 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:55:52.411101 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5900c5db-d02c-4333-82f9-affc25a4c49d" path="/var/lib/kubelet/pods/5900c5db-d02c-4333-82f9-affc25a4c49d/volumes" Jul 30 21:56:18.515625 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.515590 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n"] Jul 30 21:56:18.516721 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516695 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5900c5db-d02c-4333-82f9-affc25a4c49d" containerName="main" Jul 30 21:56:18.516721 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516723 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5900c5db-d02c-4333-82f9-affc25a4c49d" containerName="main" Jul 30 21:56:18.516936 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516748 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="855e20d6-9633-4ce6-b726-5dc97ade5fa3" containerName="revoke-keys" Jul 30 21:56:18.516936 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516758 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="855e20d6-9633-4ce6-b726-5dc97ade5fa3" containerName="revoke-keys" Jul 30 21:56:18.517044 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516982 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5900c5db-d02c-4333-82f9-affc25a4c49d" containerName="main" Jul 30 21:56:18.517044 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.516994 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="855e20d6-9633-4ce6-b726-5dc97ade5fa3" containerName="revoke-keys" Jul 30 21:56:18.521371 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.521348 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:18.524802 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.524782 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-pwwf4\"" Jul 30 21:56:18.524974 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.524837 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 30 21:56:18.526735 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.526708 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n"] Jul 30 21:56:18.601920 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.601891 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n\" (UID: \"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:18.702852 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.702819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n\" (UID: \"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:18.703487 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.703465 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n\" (UID: \"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:18.835602 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.835546 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:18.969050 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:18.969023 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n"] Jul 30 21:56:18.970763 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:56:18.970738 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c337fd1_ac7a_4cd7_a16d_438b7a93f24b.slice/crio-ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7 WatchSource:0}: Error finding container ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7: Status 404 returned error can't find the container with id ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7 Jul 30 21:56:19.704736 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:19.704699 2577 generic.go:356] "Generic (PLEG): container finished" podID="1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" containerID="0169c191d97a189b9ce5df46bf671a3f3b2bb922645118e7b190f1f90a2d9d9e" exitCode=0 Jul 30 21:56:19.705087 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:19.704750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" event={"ID":"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b","Type":"ContainerDied","Data":"0169c191d97a189b9ce5df46bf671a3f3b2bb922645118e7b190f1f90a2d9d9e"} Jul 30 21:56:19.705087 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:19.704815 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" event={"ID":"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b","Type":"ContainerStarted","Data":"ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7"} Jul 30 21:56:20.841827 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:20.841804 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:21.025679 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.025638 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca\") pod \"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b\" (UID: \"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b\") " Jul 30 21:56:21.025992 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.025970 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" (UID: "1c337fd1-ac7a-4cd7-a16d-438b7a93f24b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 30 21:56:21.126723 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.126701 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b-maas-api-service-ca\") on node \"ip-10-0-133-49.ec2.internal\" DevicePath \"\"" Jul 30 21:56:21.715349 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.715322 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" Jul 30 21:56:21.715579 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.715368 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n" event={"ID":"1c337fd1-ac7a-4cd7-a16d-438b7a93f24b","Type":"ContainerDied","Data":"ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7"} Jul 30 21:56:21.715579 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:21.715414 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca758881777aab29b4551368724b0186a6485951f517f594621e0161f67a17e7" Jul 30 21:56:29.146515 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:29.146482 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n"] Jul 30 21:56:29.149072 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:29.149050 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b274d1-4xk6n"] Jul 30 21:56:30.409769 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:30.409738 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" path="/var/lib/kubelet/pods/1c337fd1-ac7a-4cd7-a16d-438b7a93f24b/volumes" Jul 30 21:56:31.543004 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:31.542971 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:56:46.462541 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:46.462507 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5"] Jul 30 21:56:46.466169 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:46.466146 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-2abe52-29757465-xblk5"] Jul 30 21:56:48.409203 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:48.409170 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0be1ac1-f9d9-45b5-bf47-194c8fca9c27" path="/var/lib/kubelet/pods/a0be1ac1-f9d9-45b5-bf47-194c8fca9c27/volumes" Jul 30 21:56:48.783596 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:56:48.783565 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:57:06.441722 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:06.441685 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-cwxrc"] Jul 30 21:57:17.881732 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:17.881661 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcd94768-xbvwj_4d0d7bc3-9cbb-4218-9adc-f91318f25378/copy-manifests/0.log" Jul 30 21:57:17.888053 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:17.888030 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcd94768-xbvwj_4d0d7bc3-9cbb-4218-9adc-f91318f25378/manager/0.log" Jul 30 21:57:19.953842 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:19.953814 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-drl49_19fdfccd-827f-4c28-8c4a-0e410f5a545f/kuadrant-console-plugin/0.log" Jul 30 21:57:20.194076 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:20.193997 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-cwxrc_9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1/limitador/0.log" Jul 30 21:57:20.920399 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:20.920370 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65ffdd497f-4xjf7_488a546e-d475-442a-91a2-c1532d8a1d0b/kube-auth-proxy/0.log" Jul 30 21:57:21.526812 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:21.526789 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54b496f858-sg6t2_3a4b724f-e7ba-409c-bf4f-7d193d68d43e/router/0.log" Jul 30 21:57:22.156221 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:22.156182 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7wfwm_1b658d27-9877-4a27-be27-da1f29364ec0/main/0.log" Jul 30 21:57:22.275722 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:22.275696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fzwnrx_d53283fd-0e89-4ac8-b02d-72f75fc60f5f/main/0.log" Jul 30 21:57:22.393130 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:22.393090 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-x65z2_5e36c005-57ac-46df-b137-666f0c4b6c43/main/0.log" Jul 30 21:57:22.506175 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:22.506156 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-kbvz2_67f9f031-b433-46c8-8f4d-ade3e759f1cb/main/0.log" Jul 30 21:57:22.707734 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:22.707706 2577 scope.go:117] "RemoveContainer" containerID="eeb77464f4148602501bacecc4387c7a799b339602fda274bebb6694f36b7725" Jul 30 21:57:23.129630 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:23.129539 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:57:23.139823 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:23.138746 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-m6xq5_ea01edd3-1419-4ccd-8542-be10b434fb62/ovn-acl-logging/0.log" Jul 30 21:57:30.956139 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:30.956094 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mm8qr_ef8ae32e-73f5-4f4b-9cdb-f641607576b8/global-pull-secret-syncer/0.log" Jul 30 21:57:31.097759 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:31.097717 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v54mb_995d6002-a1d1-4284-8d98-e210674452e0/konnectivity-agent/0.log" Jul 30 21:57:31.174509 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:31.174482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-49.ec2.internal_1668fe2fbcb786c1ffb20c9700e9cb32/haproxy/0.log" Jul 30 21:57:36.213652 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:36.213577 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-drl49_19fdfccd-827f-4c28-8c4a-0e410f5a545f/kuadrant-console-plugin/0.log" Jul 30 21:57:36.450535 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:36.450509 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-cwxrc_9b7eeebd-8dcf-4dbb-9e6e-fffb7a7ec8e1/limitador/0.log" Jul 30 21:57:38.025086 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.025061 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/alertmanager/0.log" Jul 30 21:57:38.045392 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.045357 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/config-reloader/0.log" Jul 30 21:57:38.065306 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.065284 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/kube-rbac-proxy-web/0.log" Jul 30 21:57:38.086035 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.086008 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/kube-rbac-proxy/0.log" Jul 30 21:57:38.106950 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.106931 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/kube-rbac-proxy-metric/0.log" Jul 30 21:57:38.126384 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.126368 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/prom-label-proxy/0.log" Jul 30 21:57:38.146895 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.146873 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a0adffd5-406c-41f9-a509-5d14702f6922/init-config-reloader/0.log" Jul 30 21:57:38.333402 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.333379 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-5b56f_7b11a5f1-5ec5-481d-8e04-ff7d3d8303e3/monitoring-plugin/0.log" Jul 30 21:57:38.391156 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.391134 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gfhnv_30c8925e-a3ed-49ab-b7d4-95f6ba98e314/node-exporter/0.log" Jul 30 21:57:38.417683 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.417665 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gfhnv_30c8925e-a3ed-49ab-b7d4-95f6ba98e314/kube-rbac-proxy/0.log" Jul 30 21:57:38.440726 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.440710 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gfhnv_30c8925e-a3ed-49ab-b7d4-95f6ba98e314/init-textfile/0.log" Jul 30 21:57:38.714061 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.713995 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-4lz9s_684cb8ca-cdc3-4bc9-9125-dfe901a850ad/kube-rbac-proxy-main/0.log" Jul 30 21:57:38.736277 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.736256 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-4lz9s_684cb8ca-cdc3-4bc9-9125-dfe901a850ad/kube-rbac-proxy-self/0.log" Jul 30 21:57:38.758753 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.758731 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-4lz9s_684cb8ca-cdc3-4bc9-9125-dfe901a850ad/openshift-state-metrics/0.log" Jul 30 21:57:38.797827 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.797803 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/prometheus/0.log" Jul 30 21:57:38.819324 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.819301 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/config-reloader/0.log" Jul 30 21:57:38.841001 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.840969 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/thanos-sidecar/0.log" Jul 30 21:57:38.872154 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.872137 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/kube-rbac-proxy-web/0.log" Jul 30 21:57:38.894345 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.894330 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/kube-rbac-proxy/0.log" Jul 30 21:57:38.917716 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.917695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/kube-rbac-proxy-thanos/0.log" Jul 30 21:57:38.938925 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:38.938907 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_59c57977-4e50-426a-8f8c-27ab9c3a91ed/init-config-reloader/0.log" Jul 30 21:57:39.023323 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:39.023307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-zpnqd_fe0125f7-3398-4589-a1d9-e8cd30079184/prometheus-operator-admission-webhook/0.log" Jul 30 21:57:39.073838 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:39.073821 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668ff44fbf-vn8jf_a3895f37-9e7c-4142-87b3-a66fa6907ac1/telemeter-client/0.log" Jul 30 21:57:39.101888 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:39.101870 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668ff44fbf-vn8jf_a3895f37-9e7c-4142-87b3-a66fa6907ac1/reload/0.log" Jul 30 21:57:39.126323 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:39.126302 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-668ff44fbf-vn8jf_a3895f37-9e7c-4142-87b3-a66fa6907ac1/kube-rbac-proxy/0.log" Jul 30 21:57:40.669707 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:40.669675 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-ntjch_01e275f3-ed95-44c4-b0e7-f62b8c6b170c/networking-console-plugin/0.log" Jul 30 21:57:41.365535 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.365501 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87"] Jul 30 21:57:41.365911 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.365898 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" containerName="revoke-keys" Jul 30 21:57:41.365959 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.365912 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" containerName="revoke-keys" Jul 30 21:57:41.365994 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.365977 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c337fd1-ac7a-4cd7-a16d-438b7a93f24b" containerName="revoke-keys" Jul 30 21:57:41.369196 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.369175 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.371782 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.371762 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ptt2n\"/\"default-dockercfg-qrlrh\"" Jul 30 21:57:41.371782 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.371769 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ptt2n\"/\"kube-root-ca.crt\"" Jul 30 21:57:41.372876 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.372857 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ptt2n\"/\"openshift-service-ca.crt\"" Jul 30 21:57:41.378529 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.378509 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87"] Jul 30 21:57:41.500022 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.499999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-podres\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.500166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.500030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-sys\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.500166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.500056 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-lib-modules\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.500166 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.500163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlb4f\" (UniqueName: \"kubernetes.io/projected/f79a46ed-abd2-4888-8bca-57daa1fc2404-kube-api-access-zlb4f\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.500306 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.500191 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-proc\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601231 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-lib-modules\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601352 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601261 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlb4f\" (UniqueName: \"kubernetes.io/projected/f79a46ed-abd2-4888-8bca-57daa1fc2404-kube-api-access-zlb4f\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601352 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-proc\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601358 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-podres\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601389 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-lib-modules\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601405 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-proc\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601393 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-sys\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601484 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601439 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-sys\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.601664 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.601488 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f79a46ed-abd2-4888-8bca-57daa1fc2404-podres\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.622675 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.622626 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlb4f\" (UniqueName: \"kubernetes.io/projected/f79a46ed-abd2-4888-8bca-57daa1fc2404-kube-api-access-zlb4f\") pod \"perf-node-gather-daemonset-x4p87\" (UID: \"f79a46ed-abd2-4888-8bca-57daa1fc2404\") " pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.679316 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.679297 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:41.807071 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:41.807046 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87"] Jul 30 21:57:41.809138 ip-10-0-133-49 kubenswrapper[2577]: W0730 21:57:41.809093 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf79a46ed_abd2_4888_8bca_57daa1fc2404.slice/crio-374b3a58406b14a784f06ee2bd80a3e5ac0fe72c7ea187b48c3e6f395fd4b39a WatchSource:0}: Error finding container 374b3a58406b14a784f06ee2bd80a3e5ac0fe72c7ea187b48c3e6f395fd4b39a: Status 404 returned error can't find the container with id 374b3a58406b14a784f06ee2bd80a3e5ac0fe72c7ea187b48c3e6f395fd4b39a Jul 30 21:57:42.096751 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:42.096720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" event={"ID":"f79a46ed-abd2-4888-8bca-57daa1fc2404","Type":"ContainerStarted","Data":"eb8c1b20751925315720263039c1234a6389e43f1b2bbd37937625439606038d"} Jul 30 21:57:42.096898 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:42.096767 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" event={"ID":"f79a46ed-abd2-4888-8bca-57daa1fc2404","Type":"ContainerStarted","Data":"374b3a58406b14a784f06ee2bd80a3e5ac0fe72c7ea187b48c3e6f395fd4b39a"} Jul 30 21:57:42.096898 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:42.096788 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:42.113715 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:42.113676 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" podStartSLOduration=1.113661324 podStartE2EDuration="1.113661324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 21:57:42.111408585 +0000 UTC m=+3620.208634394" watchObservedRunningTime="2026-07-30 21:57:42.113661324 +0000 UTC m=+3620.210887116" Jul 30 21:57:42.653955 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:42.653927 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5b8776669-vwzkj_0c24c6ed-eb81-47fc-be86-f1cc3814ac5b/volume-data-source-validator/0.log" Jul 30 21:57:43.747726 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:43.747698 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hdj8x_ec285956-ca90-42d9-b8e0-3d519ffa7ed4/dns/0.log" Jul 30 21:57:43.767858 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:43.767837 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hdj8x_ec285956-ca90-42d9-b8e0-3d519ffa7ed4/kube-rbac-proxy/0.log" Jul 30 21:57:43.871744 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:43.871721 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lms86_28e33746-93cc-4ca7-890a-c836fd0a1a2e/dns-node-resolver/0.log" Jul 30 21:57:44.434839 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:44.434806 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5964d6864-77nk9_4a1cf560-39a1-426f-8d98-f4890ee3bee9/registry/0.log" Jul 30 21:57:44.457410 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:44.457385 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n564_ca185b72-0eac-4af2-aec0-3bed6a3179d9/node-ca/0.log" Jul 30 21:57:45.638632 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:45.638606 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65ffdd497f-4xjf7_488a546e-d475-442a-91a2-c1532d8a1d0b/kube-auth-proxy/0.log" Jul 30 21:57:45.788960 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:45.788933 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54b496f858-sg6t2_3a4b724f-e7ba-409c-bf4f-7d193d68d43e/router/0.log" Jul 30 21:57:46.650000 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:46.649974 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v6th8_d4999865-691c-47a9-b861-11d7f8e0544f/serve-healthcheck-canary/0.log" Jul 30 21:57:47.116238 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:47.116212 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-tpn89_0d709fe7-5c99-4cf1-a341-ed186b3a6efe/insights-operator/0.log" Jul 30 21:57:47.119031 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:47.119009 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-tpn89_0d709fe7-5c99-4cf1-a341-ed186b3a6efe/insights-operator/1.log" Jul 30 21:57:47.286476 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:47.286451 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrsfw_45a25b74-5b9a-4abf-87bb-50660e29c37d/kube-rbac-proxy/0.log" Jul 30 21:57:47.305523 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:47.305502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrsfw_45a25b74-5b9a-4abf-87bb-50660e29c37d/exporter/0.log" Jul 30 21:57:47.329763 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:47.329739 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hrsfw_45a25b74-5b9a-4abf-87bb-50660e29c37d/extractor/0.log" Jul 30 21:57:48.110467 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:48.110439 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ptt2n/perf-node-gather-daemonset-x4p87" Jul 30 21:57:50.668603 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:50.668563 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcd94768-xbvwj_4d0d7bc3-9cbb-4218-9adc-f91318f25378/manager/0.log" Jul 30 21:57:50.689594 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:50.689570 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5ddcd94768-xbvwj_4d0d7bc3-9cbb-4218-9adc-f91318f25378/copy-manifests/0.log" Jul 30 21:57:52.091148 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:52.091069 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76d7f64c45-9sv6c_999c8df0-a407-43be-ab37-9d963969ebb6/manager/0.log" Jul 30 21:57:52.415021 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:52.414949 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65ffdd497f-4xjf7_488a546e-d475-442a-91a2-c1532d8a1d0b/kube-auth-proxy/0.log" Jul 30 21:57:52.544493 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:52.544465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54b496f858-sg6t2_3a4b724f-e7ba-409c-bf4f-7d193d68d43e/router/0.log" Jul 30 21:57:54.093893 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:54.093864 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65ffdd497f-4xjf7_488a546e-d475-442a-91a2-c1532d8a1d0b/kube-auth-proxy/0.log" Jul 30 21:57:54.211811 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:54.211745 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54b496f858-sg6t2_3a4b724f-e7ba-409c-bf4f-7d193d68d43e/router/0.log" Jul 30 21:57:57.759843 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:57.759813 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-jg46g_13172577-97de-4bcf-b572-6ccbdecee317/kube-storage-version-migrator-operator/1.log" Jul 30 21:57:57.761289 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:57.761267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-jg46g_13172577-97de-4bcf-b572-6ccbdecee317/kube-storage-version-migrator-operator/0.log" Jul 30 21:57:58.936905 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:58.936878 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/kube-multus-additional-cni-plugins/0.log" Jul 30 21:57:58.960638 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:58.960608 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/egress-router-binary-copy/0.log" Jul 30 21:57:58.980109 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:58.980091 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/cni-plugins/0.log" Jul 30 21:57:59.001376 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.001331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/bond-cni-plugin/0.log" Jul 30 21:57:59.021368 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.021343 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/routeoverride-cni/0.log" Jul 30 21:57:59.042470 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.042447 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/whereabouts-cni-bincopy/0.log" Jul 30 21:57:59.061372 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.061353 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mqkt9_b908c188-aa39-4d82-83aa-4037f68d16b4/whereabouts-cni/0.log" Jul 30 21:57:59.321534 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.321504 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-slgpz_1c2bc580-9bad-4c10-948d-a36fea4f8725/kube-multus/0.log" Jul 30 21:57:59.340026 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.340004 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggzpn_d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57/network-metrics-daemon/0.log" Jul 30 21:57:59.357415 ip-10-0-133-49 kubenswrapper[2577]: I0730 21:57:59.357382 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggzpn_d6d6bcc2-c5b5-4236-b6ea-ba542ab12b57/kube-rbac-proxy/0.log"