Jul 02 14:48:17.520794 ip-10-0-131-199 systemd[1]: Starting Kubernetes Kubelet... Jul 02 14:48:17.912924 ip-10-0-131-199 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:17.912924 ip-10-0-131-199 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 14:48:17.912924 ip-10-0-131-199 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:17.912924 ip-10-0-131-199 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 14:48:17.912924 ip-10-0-131-199 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 14:48:17.913984 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.913895 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 14:48:17.922053 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922034 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.922053 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922052 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.922053 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922056 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922059 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922062 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922065 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922070 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922076 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922079 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922083 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922086 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922089 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922092 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922095 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922099 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922103 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922113 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922116 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922120 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922123 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922125 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.922146 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922128 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922131 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922134 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922137 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922140 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922143 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922145 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922148 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922151 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922153 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922156 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922159 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922162 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922165 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922168 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922171 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922173 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922177 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922179 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922182 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.922654 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922185 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922187 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922189 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922192 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922194 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922197 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922199 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922202 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922204 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922207 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922209 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922212 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922214 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922217 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922220 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922223 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922226 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922229 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922231 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922234 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.923232 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922236 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922239 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922242 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922244 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922247 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922250 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922252 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922255 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922257 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922260 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922263 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922265 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922268 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922270 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922273 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922275 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922279 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922281 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922284 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922286 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.923728 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922289 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922291 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922293 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922296 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922298 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922301 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922305 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922308 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922310 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922313 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922316 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922319 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922321 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922324 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922327 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922331 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922333 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.922336 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923081 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923090 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.924215 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923094 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923097 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923100 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923127 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923146 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923151 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923155 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923158 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923162 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923166 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923169 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923172 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923176 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923178 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923182 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923185 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923188 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923191 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923194 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923196 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.924686 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923199 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923202 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923205 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923211 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923215 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923218 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923221 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923224 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923227 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923230 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923233 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923236 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923239 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923241 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923244 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923247 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923251 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923254 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923257 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.925200 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923260 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923262 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923265 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923268 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923271 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923273 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923276 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923279 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923281 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923284 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923287 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923290 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923292 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923295 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923297 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923300 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923302 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923305 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923308 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923310 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.925669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923312 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923315 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923318 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923320 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923323 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923325 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923328 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923330 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923332 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923336 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923340 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923344 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923346 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923349 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923351 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923354 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923356 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923359 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923361 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923364 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.926141 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923366 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923369 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923371 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923374 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923376 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923379 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923383 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923387 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923390 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923392 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923395 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923398 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923400 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923404 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923407 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923410 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923413 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923416 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.926640 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923876 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923883 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923886 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923891 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923894 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923897 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923900 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923903 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923907 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923910 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923912 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923915 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923918 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923922 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923925 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923929 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923931 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923934 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923936 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923939 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.927084 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923941 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923944 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923946 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923949 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923951 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923954 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923956 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923959 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923962 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923965 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923968 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923971 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923973 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923976 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923980 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923985 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923988 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923991 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923995 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.927584 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.923997 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924000 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924004 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924007 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924010 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924013 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924016 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924018 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924021 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924025 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924027 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924030 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924033 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924035 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924038 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924040 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924043 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924046 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924048 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924051 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.928044 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924054 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924057 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924059 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924062 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924065 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924067 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924069 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924072 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924075 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924077 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924080 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924082 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924086 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924088 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924091 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924093 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924096 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924098 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924100 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924103 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.928530 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924106 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924108 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924110 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924113 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924115 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924118 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924121 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924124 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924126 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924128 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924131 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924133 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924136 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924138 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924141 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924144 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924146 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924148 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924151 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924153 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924222 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 14:48:17.929007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924230 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924236 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924240 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924244 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924248 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924252 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924257 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924260 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924263 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924267 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924270 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924273 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924276 2556 flags.go:64] FLAG: --cgroup-root="" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924279 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924282 2556 flags.go:64] FLAG: --client-ca-file="" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924285 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924288 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924292 2556 flags.go:64] FLAG: --cluster-domain="" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924295 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924298 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924301 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924305 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924308 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 14:48:17.929517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924311 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924314 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924318 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924321 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924324 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924327 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924330 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924333 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924338 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924341 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924344 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924347 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924350 2556 flags.go:64] FLAG: --enable-server="true" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924353 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924362 2556 flags.go:64] FLAG: --event-burst="100" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924365 2556 flags.go:64] FLAG: --event-qps="50" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924367 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924371 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924374 2556 flags.go:64] FLAG: --eviction-hard="" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924378 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924381 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924384 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924387 2556 flags.go:64] FLAG: --eviction-soft="" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924390 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924392 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 14:48:17.930061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924395 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924398 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924401 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924404 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924407 2556 flags.go:64] FLAG: --feature-gates="" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924411 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924414 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924421 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924424 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924427 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924430 2556 flags.go:64] FLAG: --help="false" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924433 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-131-199.ec2.internal" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924436 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924439 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924442 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924446 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924449 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924452 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924454 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924457 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924473 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924477 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924480 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924483 2556 flags.go:64] FLAG: --kube-reserved="" Jul 02 14:48:17.930728 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924486 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924489 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924492 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924495 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924498 2556 flags.go:64] FLAG: --lock-file="" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924501 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924504 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924507 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924512 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924515 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924518 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924521 2556 flags.go:64] FLAG: --logging-format="text" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924525 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924529 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924531 2556 flags.go:64] FLAG: --manifest-url="" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924558 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924564 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924568 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924572 2556 flags.go:64] FLAG: --max-pods="110" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924575 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924578 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924581 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924584 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924587 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924590 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 14:48:17.931303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924594 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924601 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924604 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924607 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924610 2556 flags.go:64] FLAG: --pod-cidr="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924613 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924619 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924622 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924625 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924628 2556 flags.go:64] FLAG: --port="10250" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924632 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924635 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08f92540850f5199f" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924638 2556 flags.go:64] FLAG: --qos-reserved="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924641 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924644 2556 flags.go:64] FLAG: --register-node="true" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924647 2556 flags.go:64] FLAG: --register-with-taints="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924650 2556 flags.go:64] FLAG: --registry-burst="10" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924653 2556 flags.go:64] FLAG: --registry-qps="5" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924656 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924659 2556 flags.go:64] FLAG: --reserved-memory="" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924666 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924669 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924674 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924679 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924682 2556 flags.go:64] FLAG: --runonce="false" Jul 02 14:48:17.931996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924684 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924687 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924691 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924694 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924696 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924700 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924703 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924706 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924709 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924711 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924714 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924717 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924720 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924723 2556 flags.go:64] FLAG: --system-cgroups="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924727 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924732 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924735 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924738 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924742 2556 flags.go:64] FLAG: --tls-min-version="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924744 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924747 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924750 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924753 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924756 2556 flags.go:64] FLAG: --v="2" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924759 2556 flags.go:64] FLAG: --version="false" Jul 02 14:48:17.932621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924763 2556 flags.go:64] FLAG: --vmodule="" Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924767 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.924771 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924880 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924885 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924889 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924892 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924895 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924899 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924901 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924904 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924907 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924910 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924913 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924917 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924920 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924924 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924927 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924930 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.933235 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924932 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924935 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924937 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924941 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924944 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924946 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924950 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924954 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924957 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924960 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924963 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924965 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924968 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924971 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924973 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924976 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924978 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924981 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924985 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924987 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.933693 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924990 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924993 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924996 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.924999 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925002 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925004 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925007 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925009 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925012 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925014 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925017 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925020 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925022 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925025 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925027 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925030 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925033 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925036 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925038 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925041 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.934203 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925043 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925046 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925049 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925051 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925054 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925057 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925060 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925063 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925065 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925068 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925072 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925074 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925077 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925080 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925082 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925085 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925087 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925090 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925092 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925095 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.934710 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925098 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925100 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925103 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925105 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925108 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925110 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925113 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925116 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925118 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925121 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925124 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925126 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925129 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925131 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925134 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925136 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925139 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925141 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925143 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925146 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.935189 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925148 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925151 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.925155 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.925928 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.933597 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.933614 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.933635 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.933644 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933716 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933722 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933725 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933728 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933731 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933734 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933737 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.935767 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933740 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933743 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933746 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933749 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933751 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933754 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933756 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933759 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933761 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933764 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933767 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933769 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933774 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933777 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933780 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933783 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933785 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933788 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933790 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.936149 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933793 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933796 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933805 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933809 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933811 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933814 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933816 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933819 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933822 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933824 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933827 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933830 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933833 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933835 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933838 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933840 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933843 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933846 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933848 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933852 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.936624 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933855 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933858 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933861 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933864 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933866 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933869 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933872 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933875 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933877 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933880 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933883 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933885 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933888 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933890 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933893 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933901 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933904 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933906 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933909 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933911 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.937098 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933914 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933918 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933921 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933924 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933927 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933930 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933933 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933936 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933938 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933941 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933944 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933947 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933950 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933953 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933956 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933958 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933961 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933963 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933966 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.937703 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933969 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933971 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933974 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933976 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933979 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933982 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933984 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933986 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933989 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.933997 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934000 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934002 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934005 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934007 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.934013 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:17.938153 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934165 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934169 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934172 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934175 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934178 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934181 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934184 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934187 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934190 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934194 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934197 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934200 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934203 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934205 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934208 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934211 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934214 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934216 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934220 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 14:48:17.938635 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934222 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934225 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934228 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934230 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934232 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934235 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934237 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934240 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934249 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934251 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934254 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934256 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934259 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934261 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934264 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934267 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934269 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934272 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934274 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934277 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 14:48:17.939107 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934279 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934282 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934284 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934287 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934289 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934292 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934294 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934297 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934299 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934302 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934304 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934307 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934309 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934312 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934314 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934317 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934319 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934322 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934325 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 14:48:17.939609 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934328 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934330 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934338 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934341 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934344 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934346 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934350 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934352 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934355 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934358 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934360 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934362 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934365 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934367 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934370 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934372 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934375 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934377 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934379 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934382 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 14:48:17.940065 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934384 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934387 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934390 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934392 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934395 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934398 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934400 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934403 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934406 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934410 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934413 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934416 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934418 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934421 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934423 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934431 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934434 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934437 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934440 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934442 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 14:48:17.940559 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:17.934445 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 14:48:17.941048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.934449 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 14:48:17.941048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.934597 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 14:48:17.941048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.937234 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 14:48:17.941048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.940938 2556 server.go:1019] "Starting client certificate rotation" Jul 02 14:48:17.941160 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.941057 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:17.941160 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.941137 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 14:48:17.946209 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.946178 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:17.948658 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.948638 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 14:48:17.960658 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.960635 2556 log.go:25] "Validated CRI v1 runtime API" Jul 02 14:48:17.963274 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.963258 2556 log.go:25] "Validated CRI v1 image API" Jul 02 14:48:17.964159 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.964143 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 14:48:17.969705 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.969681 2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e492882e-d290-48b4-8e9a-2d5456b8942b:/dev/nvme0n1p4 f67e0647-df14-45f2-93ea-a0b48a6a1f73:/dev/nvme0n1p3] Jul 02 14:48:17.969768 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.969705 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 14:48:17.975703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.975588 2556 manager.go:216] Machine: {Timestamp:2026-07-02 14:48:17.974199368 +0000 UTC m=+0.337016795 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100107 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec298e06676bf2a19c956ff3195312ac SystemUUID:ec298e06-676b-f2a1-9c95-6ff3195312ac BootID:88612ad1-8371-47f6-aac5-6657077fec82 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:03:4e:25:ae:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:03:4e:25:ae:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:ee:d8:d9:c4:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 14:48:17.975703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.975693 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 14:48:17.975818 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.975774 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 14:48:17.976308 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.976293 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:17.979288 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.979259 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 14:48:17.979440 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.979307 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-199.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 14:48:17.980790 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.980780 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 14:48:17.980822 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.980793 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 14:48:17.980822 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.980801 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:17.981601 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.981590 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 14:48:17.982874 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.982864 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 14:48:17.986345 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986335 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:17.986453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986445 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 14:48:17.986494 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986489 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 02 14:48:17.986529 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986500 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 14:48:17.986529 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986519 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 14:48:17.986529 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986529 2556 kubelet.go:398] "Adding apiserver pod source" Jul 02 14:48:17.986610 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986538 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 14:48:17.986857 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986847 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:17.986917 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.986863 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 14:48:17.989394 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.989381 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 14:48:17.991936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.991916 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 14:48:17.992073 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992054 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 14:48:17.992940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992926 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 14:48:17.992993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992947 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 14:48:17.992993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992961 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 14:48:17.992993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992967 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 14:48:17.992993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992978 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 14:48:17.992993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.992987 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993000 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993008 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993021 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993030 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993043 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 14:48:17.993142 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993058 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 14:48:17.993922 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993904 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 14:48:17.993988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.993939 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 14:48:17.997221 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.997204 2556 server.go:1268] "Started kubelet" Jul 02 14:48:17.997399 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.997371 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 14:48:17.997562 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.997369 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 14:48:17.997628 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.997599 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 14:48:17.998030 ip-10-0-131-199 systemd[1]: Started Kubernetes Kubelet. Jul 02 14:48:17.998837 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:17.998742 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-199.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 14:48:17.998904 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:17.998878 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 14:48:17.998998 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:17.998903 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 14:48:18.000262 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.000248 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 02 14:48:18.002045 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.002026 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 14:48:18.004500 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.004481 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 14:48:18.008697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.007597 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-199.ec2.internal.18be806aa4546b35 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-199.ec2.internal,UID:ip-10-0-131-199.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-199.ec2.internal,},FirstTimestamp:2026-07-02 14:48:17.997179701 +0000 UTC m=+0.359997128,LastTimestamp:2026-07-02 14:48:17.997179701 +0000 UTC m=+0.359997128,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-199.ec2.internal,}" Jul 02 14:48:18.011144 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.011126 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 14:48:18.011144 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.011140 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:18.011259 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.011196 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.011879 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.011863 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 14:48:18.012003 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.011868 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 14:48:18.012112 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012008 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 14:48:18.012112 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012097 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 02 14:48:18.012112 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012106 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 02 14:48:18.012336 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012321 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 14:48:18.012336 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012339 2556 factory.go:55] Registering systemd factory Jul 02 14:48:18.012449 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012349 2556 factory.go:223] Registration of the systemd container factory successfully Jul 02 14:48:18.012594 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012581 2556 factory.go:153] Registering CRI-O factory Jul 02 14:48:18.012647 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012596 2556 factory.go:223] Registration of the crio container factory successfully Jul 02 14:48:18.012647 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012613 2556 factory.go:103] Registering Raw factory Jul 02 14:48:18.012647 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012622 2556 manager.go:1196] Started watching for new ooms in manager Jul 02 14:48:18.012993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.012981 2556 manager.go:349] Starting recovery of all containers Jul 02 14:48:18.014255 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.014059 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-199.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 14:48:18.014255 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.014213 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 14:48:18.020671 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.020654 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvvmc" Jul 02 14:48:18.023270 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.023248 2556 manager.go:354] Recovery completed Jul 02 14:48:18.028158 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.028145 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.029528 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.029513 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fvvmc" Jul 02 14:48:18.029941 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.029925 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.030004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.029954 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.030004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.029964 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.030498 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.030482 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 14:48:18.030498 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.030498 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 14:48:18.030591 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.030514 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 02 14:48:18.030591 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.030488 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.031281 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.031266 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.031373 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.031296 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.031373 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.031312 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.032250 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.032238 2556 policy_none.go:49] "None policy: Start" Jul 02 14:48:18.032306 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.032253 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 14:48:18.032306 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.032263 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 14:48:18.033343 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.033328 2556 policy_none.go:47] "Start" Jul 02 14:48:18.070031 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070015 2556 manager.go:337] "Starting Device Plugin manager" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.070047 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070057 2556 server.go:87] "Starting device plugin registration server" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070324 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070337 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070518 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070603 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.070614 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.071122 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.071172 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.078247 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.079409 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.079445 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.079483 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.079524 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 14:48:18.082895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.082125 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:18.170679 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.170571 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.171573 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.171555 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.171672 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.171587 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.171672 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.171599 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.171672 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.171628 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.179965 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.179934 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal"] Jul 02 14:48:18.180023 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.180007 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.180803 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.180788 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.180860 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.180823 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.180860 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.180835 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.182280 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.182267 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.182399 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.182385 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.182452 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.182413 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.182995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.182978 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.183064 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183002 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.183064 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183011 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.183064 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183026 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.183064 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183043 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.183064 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183054 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.183432 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.183420 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.183491 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.183438 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-199.ec2.internal\": node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.184258 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.184243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.184303 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.184277 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 14:48:18.184885 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.184869 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientMemory" Jul 02 14:48:18.184997 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.184896 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 14:48:18.184997 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.184908 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeHasSufficientPID" Jul 02 14:48:18.198071 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.198044 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.207355 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.207332 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-199.ec2.internal\" not found" node="ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.211777 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.211758 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-199.ec2.internal\" not found" node="ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.298455 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.298419 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.313819 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.313793 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.313919 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.313824 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.313919 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.313843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebed2cfefda3d3501e2c36adef46adbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-199.ec2.internal\" (UID: \"ebed2cfefda3d3501e2c36adef46adbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.399328 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.399295 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.414786 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414759 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.414883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.414883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414827 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.414883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414848 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebed2cfefda3d3501e2c36adef46adbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-199.ec2.internal\" (UID: \"ebed2cfefda3d3501e2c36adef46adbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.414883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414877 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ebed2cfefda3d3501e2c36adef46adbf-config\") pod \"kube-apiserver-proxy-ip-10-0-131-199.ec2.internal\" (UID: \"ebed2cfefda3d3501e2c36adef46adbf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.414883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.414881 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2840b7062d4a7fb57e53119467e5f890-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal\" (UID: \"2840b7062d4a7fb57e53119467e5f890\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.500262 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.500185 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.511370 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.511337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.516634 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.516611 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:18.600770 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.600731 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.701309 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.701277 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.801890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.801813 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.858023 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.857999 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:18.902520 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:18.902498 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:18.908844 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.908828 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:18.938375 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.938354 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 14:48:18.938799 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.938510 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:18.938799 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.938527 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:18.938799 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:18.938534 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 14:48:19.003533 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.003505 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:19.034911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.034850 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 14:43:17 +0000 UTC" deadline="2028-03-02 17:19:37.450111987 +0000 UTC" Jul 02 14:48:19.035005 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.034911 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14618h31m18.415203369s" Jul 02 14:48:19.104180 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.104143 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:19.129183 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:19.129147 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebed2cfefda3d3501e2c36adef46adbf.slice/crio-4141a8c501857476bf261c20dc49fe359e1b4d0d9fbd7b73a089f05af485d980 WatchSource:0}: Error finding container 4141a8c501857476bf261c20dc49fe359e1b4d0d9fbd7b73a089f05af485d980: Status 404 returned error can't find the container with id 4141a8c501857476bf261c20dc49fe359e1b4d0d9fbd7b73a089f05af485d980 Jul 02 14:48:19.129570 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:19.129549 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2840b7062d4a7fb57e53119467e5f890.slice/crio-3feb1a8b4fddcb7c4df583505a59f381cfd139ca6a4cda7d349f7aa983b20316 WatchSource:0}: Error finding container 3feb1a8b4fddcb7c4df583505a59f381cfd139ca6a4cda7d349f7aa983b20316: Status 404 returned error can't find the container with id 3feb1a8b4fddcb7c4df583505a59f381cfd139ca6a4cda7d349f7aa983b20316 Jul 02 14:48:19.134273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.134254 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:48:19.204967 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.204928 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:19.305276 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.305216 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:19.405585 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.405556 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-199.ec2.internal\" not found" Jul 02 14:48:19.495016 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.494991 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:19.511394 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.511372 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" Jul 02 14:48:19.521155 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.521138 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:19.522130 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.522118 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" Jul 02 14:48:19.528007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.527995 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 14:48:19.894903 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.894873 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:19.987931 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.987899 2556 apiserver.go:52] "Watching apiserver" Jul 02 14:48:19.996019 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.995993 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 14:48:19.997940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.997912 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-smsbw","kube-system/global-pull-secret-syncer-9mrw9","kube-system/konnectivity-agent-h82zf","openshift-cluster-node-tuning-operator/tuned-5zh89","openshift-dns/node-resolver-pgr9x","openshift-image-registry/node-ca-xh76s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal","openshift-multus/multus-9vl9j","openshift-multus/network-metrics-daemon-pls7k","kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn","openshift-multus/multus-additional-cni-plugins-w7knw","openshift-network-diagnostics/network-check-target-cxgv7","openshift-network-operator/iptables-alerter-k56vv"] Jul 02 14:48:19.999678 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:19.999654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:19.999787 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:19.999734 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:20.000940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.000912 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.001032 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.000979 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:20.002339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.002235 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.004104 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.004082 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 14:48:20.004287 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.004270 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 14:48:20.004347 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.004263 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rs9p2\"" Jul 02 14:48:20.004617 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.004456 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.005547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.005371 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.006426 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.006387 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.006537 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.006436 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.006537 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.006498 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qhdmv\"" Jul 02 14:48:20.007087 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.007070 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.007162 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.007121 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.007227 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.007209 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fhnnm\"" Jul 02 14:48:20.007227 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.007224 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.008544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.008527 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-95kgg\"" Jul 02 14:48:20.008824 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.008803 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.008917 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.008860 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.009136 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.009119 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.009265 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.009251 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 14:48:20.010397 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.010379 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.010625 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.010608 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 14:48:20.011126 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.011070 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 14:48:20.011212 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.011174 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.011924 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.011278 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 14:48:20.011924 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.011890 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 14:48:20.012269 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.012011 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.012269 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.012046 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 14:48:20.013376 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.013352 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zmsnh\"" Jul 02 14:48:20.013485 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.013380 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.015256 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.014302 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.015256 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.014450 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:20.015399 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.015367 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 14:48:20.016883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.015482 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.016883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.015801 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 14:48:20.016883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.016347 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v82j7\"" Jul 02 14:48:20.017071 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.016959 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.019035 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.019016 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.019121 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.019048 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.019473 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.019405 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nmwvh\"" Jul 02 14:48:20.019473 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.019428 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.019617 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.019505 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 14:48:20.020621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.020482 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 14:48:20.020804 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.020786 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 14:48:20.020911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.020897 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xsv9l\"" Jul 02 14:48:20.020971 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.020908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.021003 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.020993 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 14:48:20.022793 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022773 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 14:48:20.022874 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022808 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rj5sp\"" Jul 02 14:48:20.022874 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-k8s-cni-cncf-io\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022885 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022773 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022909 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-etc-tuned\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvvg2\" (UniqueName: \"kubernetes.io/projected/31468509-9602-47e0-a0b6-c441b943d622-kube-api-access-kvvg2\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022958 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:20.022995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.022979 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-etc-kubernetes\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-lib-modules\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-var-lib-kubelet\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-system-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-hostroot\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023162 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-conf\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d895\" (UniqueName: \"kubernetes.io/projected/a159d716-d59c-499c-80a4-68643dfed1d3-kube-api-access-4d895\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-script-lib\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023247 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrng4\" (UniqueName: \"kubernetes.io/projected/4eb3595c-f569-4edd-98a3-1fa60e64dd50-kube-api-access-vrng4\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-os-release\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023291 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ece0b50-4597-44e4-bcd1-75d36b7de366-host-slash\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023314 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-host\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023336 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdx99\" (UniqueName: \"kubernetes.io/projected/83aacf8c-2ff4-414f-9877-418f528d0e7c-kube-api-access-jdx99\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023357 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-cnibin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-run\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023436 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-dbus\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023474 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-netns\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-node-log\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-kubelet\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-multus-daemon-config\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ece0b50-4597-44e4-bcd1-75d36b7de366-iptables-alerter-script\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023650 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-tmp\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023675 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83aacf8c-2ff4-414f-9877-418f528d0e7c-host\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023703 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-var-lib-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.023791 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-ovn\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023796 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023845 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovn-node-metrics-cert\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-netns\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023903 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-modprobe-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31468509-9602-47e0-a0b6-c441b943d622-hosts-file\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023945 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-kubelet\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.023982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-bin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024004 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5812f804-ea2f-4103-bc95-4841140f4fbe-konnectivity-ca\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024023 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5mcq\" (UniqueName: \"kubernetes.io/projected/2ca7704b-8f91-4c64-8f35-0f295d28debd-kube-api-access-m5mcq\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-env-overrides\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-multus-certs\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-systemd\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-etc-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-netd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-cni-binary-copy\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.024547 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-multus\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024183 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzlg6\" (UniqueName: \"kubernetes.io/projected/6ece0b50-4597-44e4-bcd1-75d36b7de366-kube-api-access-dzlg6\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysconfig\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024273 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31468509-9602-47e0-a0b6-c441b943d622-tmp-dir\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024300 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-kubelet-config\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024323 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5812f804-ea2f-4103-bc95-4841140f4fbe-agent-certs\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-systemd-units\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-slash\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-systemd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024484 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-bin\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024506 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-kubernetes\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024528 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-sys\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-log-socket\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024574 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-socket-dir-parent\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024595 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-conf-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wd9f\" (UniqueName: \"kubernetes.io/projected/62236a31-896b-491c-b2af-e4f2e0b25061-kube-api-access-5wd9f\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.025372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024637 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83aacf8c-2ff4-414f-9877-418f528d0e7c-serviceca\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.026202 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.024668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-config\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.026202 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.025262 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 14:48:20.046023 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.045999 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7d9dj" Jul 02 14:48:20.054063 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.053945 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7d9dj" Jul 02 14:48:20.085763 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.085721 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" event={"ID":"ebed2cfefda3d3501e2c36adef46adbf","Type":"ContainerStarted","Data":"4141a8c501857476bf261c20dc49fe359e1b4d0d9fbd7b73a089f05af485d980"} Jul 02 14:48:20.087020 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.086985 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" event={"ID":"2840b7062d4a7fb57e53119467e5f890","Type":"ContainerStarted","Data":"3feb1a8b4fddcb7c4df583505a59f381cfd139ca6a4cda7d349f7aa983b20316"} Jul 02 14:48:20.113083 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.113057 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 14:48:20.125149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cnibin\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-var-lib-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-ovn\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125259 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125267 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-var-lib-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125283 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovn-node-metrics-cert\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125356 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-netns\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-modprobe-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31468509-9602-47e0-a0b6-c441b943d622-hosts-file\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-kubelet\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125496 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-bin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125499 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-netns\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125520 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5812f804-ea2f-4103-bc95-4841140f4fbe-konnectivity-ca\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125543 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5mcq\" (UniqueName: \"kubernetes.io/projected/2ca7704b-8f91-4c64-8f35-0f295d28debd-kube-api-access-m5mcq\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125620 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-env-overrides\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-modprobe-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-multus-certs\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125705 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-systemd\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125706 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-etc-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125761 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-kubelet\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-netd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-cni-binary-copy\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-multus\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.125878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125878 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzlg6\" (UniqueName: \"kubernetes.io/projected/6ece0b50-4597-44e4-bcd1-75d36b7de366-kube-api-access-dzlg6\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125904 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysconfig\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31468509-9602-47e0-a0b6-c441b943d622-tmp-dir\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125955 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-os-release\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-kubelet-config\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126004 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5812f804-ea2f-4103-bc95-4841140f4fbe-agent-certs\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-systemd-units\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-slash\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-systemd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126142 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-bin\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126175 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-kubernetes\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126188 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5812f804-ea2f-4103-bc95-4841140f4fbe-konnectivity-ca\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126199 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-sys\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126225 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-etc-selinux\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126243 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-env-overrides\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126254 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-ovn\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.126540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-log-socket\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126286 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-socket-dir-parent\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126308 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-multus-certs\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126331 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-conf-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126338 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126369 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-kubelet-config\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126373 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-bin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126375 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wd9f\" (UniqueName: \"kubernetes.io/projected/62236a31-896b-491c-b2af-e4f2e0b25061-kube-api-access-5wd9f\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126404 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-systemd-units\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126426 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-netd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126426 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83aacf8c-2ff4-414f-9877-418f528d0e7c-serviceca\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126498 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-run-systemd\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126568 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-registration-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126560 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-etc-openvswitch\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126629 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxn8t\" (UniqueName: \"kubernetes.io/projected/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kube-api-access-gxn8t\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.125721 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/31468509-9602-47e0-a0b6-c441b943d622-hosts-file\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.127316 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-sys\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126775 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-config\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126795 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysconfig\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126809 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-kubernetes\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-k8s-cni-cncf-io\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126879 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/83aacf8c-2ff4-414f-9877-418f528d0e7c-serviceca\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-cni-bin\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.126972 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.126392 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-systemd\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.127094 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31468509-9602-47e0-a0b6-c441b943d622-tmp-dir\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.127114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-etc-tuned\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.127144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvvg2\" (UniqueName: \"kubernetes.io/projected/31468509-9602-47e0-a0b6-c441b943d622-kube-api-access-kvvg2\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.127179 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:20.128187 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.128141 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-slash\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.128858 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.128663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-config\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.128858 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.128733 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-run-k8s-cni-cncf-io\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129086 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129062 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-cni-binary-copy\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129186 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129186 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129165 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-etc-kubernetes\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129291 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129192 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-lib-modules\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.129291 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-var-lib-kubelet\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.129291 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.129437 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.129321 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:20.629290048 +0000 UTC m=+2.992107465 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:20.129437 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129350 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-conf-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129437 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129406 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-d\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.129628 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129609 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-system-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129773 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129751 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.129934 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.129915 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5812f804-ea2f-4103-bc95-4841140f4fbe-agent-certs\") pod \"konnectivity-agent-h82zf\" (UID: \"5812f804-ea2f-4103-bc95-4841140f4fbe\") " pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.130048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130004 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-log-socket\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.130157 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130066 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-etc-kubernetes\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.130157 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130143 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-lib-modules\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.130262 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130210 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-multus-socket-dir-parent\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.130310 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130250 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-cni-multus\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.130358 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130338 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-hostroot\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.130407 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130362 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-var-lib-kubelet\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.130407 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-conf\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d895\" (UniqueName: \"kubernetes.io/projected/a159d716-d59c-499c-80a4-68643dfed1d3-kube-api-access-4d895\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130527 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-script-lib\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130587 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovn-node-metrics-cert\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrng4\" (UniqueName: \"kubernetes.io/projected/4eb3595c-f569-4edd-98a3-1fa60e64dd50-kube-api-access-vrng4\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130754 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-etc-sysctl-conf\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130907 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-system-cni-dir\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.130977 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-hostroot\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131005 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-os-release\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131171 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-os-release\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131223 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4eb3595c-f569-4edd-98a3-1fa60e64dd50-ovnkube-script-lib\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ece0b50-4597-44e4-bcd1-75d36b7de366-host-slash\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.131339 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-host\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdx99\" (UniqueName: \"kubernetes.io/projected/83aacf8c-2ff4-414f-9877-418f528d0e7c-kube-api-access-jdx99\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131454 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131500 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-sys-fs\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-cnibin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131575 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-run\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131733 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-socket-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-dbus\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-netns\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.131933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131915 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-node-log\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-etc-tuned\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.131965 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-kubelet\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132045 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-run\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132053 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-multus-daemon-config\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132277 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ece0b50-4597-44e4-bcd1-75d36b7de366-iptables-alerter-script\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.132368 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.132357 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132451 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6ece0b50-4597-44e4-bcd1-75d36b7de366-host-slash\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132544 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-host-var-lib-kubelet\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132598 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a159d716-d59c-499c-80a4-68643dfed1d3-host\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62236a31-896b-491c-b2af-e4f2e0b25061-cnibin\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-tmp\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132683 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83aacf8c-2ff4-414f-9877-418f528d0e7c-host\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.132744 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132725 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf878\" (UniqueName: \"kubernetes.io/projected/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-kube-api-access-zf878\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.133047 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.132767 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-device-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133263 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/62236a31-896b-491c-b2af-e4f2e0b25061-multus-daemon-config\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133379 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd1bac5c-4bd8-4cf7-8636-16934550df45-dbus\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133434 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6ece0b50-4597-44e4-bcd1-75d36b7de366-iptables-alerter-script\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-run-netns\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.133524 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:20.633507137 +0000 UTC m=+2.996324553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133621 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-node-log\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133671 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/83aacf8c-2ff4-414f-9877-418f528d0e7c-host\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.134561 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.133763 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4eb3595c-f569-4edd-98a3-1fa60e64dd50-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.136334 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.136237 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:20.136334 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.136260 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:20.136334 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.136275 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:20.136334 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.136326 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:20.636309382 +0000 UTC m=+2.999126806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:20.136672 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.136646 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a159d716-d59c-499c-80a4-68643dfed1d3-tmp\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.137856 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.137815 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzlg6\" (UniqueName: \"kubernetes.io/projected/6ece0b50-4597-44e4-bcd1-75d36b7de366-kube-api-access-dzlg6\") pod \"iptables-alerter-k56vv\" (UID: \"6ece0b50-4597-44e4-bcd1-75d36b7de366\") " pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.138775 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.138755 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5mcq\" (UniqueName: \"kubernetes.io/projected/2ca7704b-8f91-4c64-8f35-0f295d28debd-kube-api-access-m5mcq\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.139077 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.139058 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wd9f\" (UniqueName: \"kubernetes.io/projected/62236a31-896b-491c-b2af-e4f2e0b25061-kube-api-access-5wd9f\") pod \"multus-9vl9j\" (UID: \"62236a31-896b-491c-b2af-e4f2e0b25061\") " pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.144583 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.144565 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrng4\" (UniqueName: \"kubernetes.io/projected/4eb3595c-f569-4edd-98a3-1fa60e64dd50-kube-api-access-vrng4\") pod \"ovnkube-node-smsbw\" (UID: \"4eb3595c-f569-4edd-98a3-1fa60e64dd50\") " pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.144675 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.144614 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvvg2\" (UniqueName: \"kubernetes.io/projected/31468509-9602-47e0-a0b6-c441b943d622-kube-api-access-kvvg2\") pod \"node-resolver-pgr9x\" (UID: \"31468509-9602-47e0-a0b6-c441b943d622\") " pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.144801 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.144786 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d895\" (UniqueName: \"kubernetes.io/projected/a159d716-d59c-499c-80a4-68643dfed1d3-kube-api-access-4d895\") pod \"tuned-5zh89\" (UID: \"a159d716-d59c-499c-80a4-68643dfed1d3\") " pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.144992 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.144936 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdx99\" (UniqueName: \"kubernetes.io/projected/83aacf8c-2ff4-414f-9877-418f528d0e7c-kube-api-access-jdx99\") pod \"node-ca-xh76s\" (UID: \"83aacf8c-2ff4-414f-9877-418f528d0e7c\") " pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.233748 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-etc-selinux\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.233920 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-registration-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.233920 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxn8t\" (UniqueName: \"kubernetes.io/projected/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kube-api-access-gxn8t\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.233920 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233827 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.233920 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.233920 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233889 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-sys-fs\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233913 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-socket-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.233997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf878\" (UniqueName: \"kubernetes.io/projected/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-kube-api-access-zf878\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-device-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234046 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cnibin\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234111 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234177 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-os-release\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234602 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234284 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-os-release\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.234602 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234397 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-etc-selinux\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234602 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234459 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-registration-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234838 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-device-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.234838 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234813 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.235003 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234876 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cnibin\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.235003 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.235003 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.234995 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.235150 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.235053 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-sys-fs\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.235150 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.235103 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e1247260-fc5c-43f7-8eac-f26ccaa31bef-socket-dir\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.235503 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.235455 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.235578 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.235523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.236309 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.236289 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.243258 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.243237 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf878\" (UniqueName: \"kubernetes.io/projected/dd9c66a5-dc2d-4e26-a947-cdf802303f3d-kube-api-access-zf878\") pod \"multus-additional-cni-plugins-w7knw\" (UID: \"dd9c66a5-dc2d-4e26-a947-cdf802303f3d\") " pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.243352 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.243288 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxn8t\" (UniqueName: \"kubernetes.io/projected/e1247260-fc5c-43f7-8eac-f26ccaa31bef-kube-api-access-gxn8t\") pod \"aws-ebs-csi-driver-node-tm6dn\" (UID: \"e1247260-fc5c-43f7-8eac-f26ccaa31bef\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.319377 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.319339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:20.331414 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.331391 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5zh89" Jul 02 14:48:20.340926 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.340899 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pgr9x" Jul 02 14:48:20.345017 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.344997 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh76s" Jul 02 14:48:20.353276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.353124 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:20.361685 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.361631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9vl9j" Jul 02 14:48:20.369847 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.369825 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k56vv" Jul 02 14:48:20.377964 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.377943 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" Jul 02 14:48:20.386817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.386800 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7knw" Jul 02 14:48:20.637184 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.637155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.637191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.637231 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637310 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637312 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637329 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637346 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:20.637356 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637356 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:20.637697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637371 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.637342844 +0000 UTC m=+4.000160257 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:20.637697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637384 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.637378331 +0000 UTC m=+4.000195745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:20.637697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:20.637395 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:21.637389148 +0000 UTC m=+4.000206562 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:20.972722 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:20.972690 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:21.056703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.056665 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:20 +0000 UTC" deadline="2027-12-26 23:43:51.009832769 +0000 UTC" Jul 02 14:48:21.056703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.056694 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13016h55m29.953141938s" Jul 02 14:48:21.080136 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.080106 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:21.080280 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.080233 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:21.180835 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.180748 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb3595c_f569_4edd_98a3_1fa60e64dd50.slice/crio-cdd2f47b65348135c3948a699e0c7441b8a41d3f07eef89ece78a252d2dffc00 WatchSource:0}: Error finding container cdd2f47b65348135c3948a699e0c7441b8a41d3f07eef89ece78a252d2dffc00: Status 404 returned error can't find the container with id cdd2f47b65348135c3948a699e0c7441b8a41d3f07eef89ece78a252d2dffc00 Jul 02 14:48:21.181873 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.181849 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83aacf8c_2ff4_414f_9877_418f528d0e7c.slice/crio-82841163670bf50a4ca43e36297c1b0a501b315c6e084035faca22caeaf39f2f WatchSource:0}: Error finding container 82841163670bf50a4ca43e36297c1b0a501b315c6e084035faca22caeaf39f2f: Status 404 returned error can't find the container with id 82841163670bf50a4ca43e36297c1b0a501b315c6e084035faca22caeaf39f2f Jul 02 14:48:21.182627 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.182606 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62236a31_896b_491c_b2af_e4f2e0b25061.slice/crio-32803e4d5fb4cde5cb0d6943f545a46ac27c454c371a3bc8bf409734afa3d7c1 WatchSource:0}: Error finding container 32803e4d5fb4cde5cb0d6943f545a46ac27c454c371a3bc8bf409734afa3d7c1: Status 404 returned error can't find the container with id 32803e4d5fb4cde5cb0d6943f545a46ac27c454c371a3bc8bf409734afa3d7c1 Jul 02 14:48:21.184425 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.184405 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5812f804_ea2f_4103_bc95_4841140f4fbe.slice/crio-1ce4d9d388b3aa4e2282ecbb0761b037f59462aa8da01832182894fe0d3f8042 WatchSource:0}: Error finding container 1ce4d9d388b3aa4e2282ecbb0761b037f59462aa8da01832182894fe0d3f8042: Status 404 returned error can't find the container with id 1ce4d9d388b3aa4e2282ecbb0761b037f59462aa8da01832182894fe0d3f8042 Jul 02 14:48:21.188272 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.188247 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ece0b50_4597_44e4_bcd1_75d36b7de366.slice/crio-86a62a4284a176623ec9e865ec08580f532a0e4bad3315268cd5dfe3313ae5db WatchSource:0}: Error finding container 86a62a4284a176623ec9e865ec08580f532a0e4bad3315268cd5dfe3313ae5db: Status 404 returned error can't find the container with id 86a62a4284a176623ec9e865ec08580f532a0e4bad3315268cd5dfe3313ae5db Jul 02 14:48:21.188969 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.188948 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9c66a5_dc2d_4e26_a947_cdf802303f3d.slice/crio-56c50307ba0f9eacc92b74a91514382acbabffe8cf03dd3e9972c5739e6d4b67 WatchSource:0}: Error finding container 56c50307ba0f9eacc92b74a91514382acbabffe8cf03dd3e9972c5739e6d4b67: Status 404 returned error can't find the container with id 56c50307ba0f9eacc92b74a91514382acbabffe8cf03dd3e9972c5739e6d4b67 Jul 02 14:48:21.190110 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.190075 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1247260_fc5c_43f7_8eac_f26ccaa31bef.slice/crio-d2905dbb2ba8a299312ef041cf41586c8e2be363df8a2fecab4325a3af0744e9 WatchSource:0}: Error finding container d2905dbb2ba8a299312ef041cf41586c8e2be363df8a2fecab4325a3af0744e9: Status 404 returned error can't find the container with id d2905dbb2ba8a299312ef041cf41586c8e2be363df8a2fecab4325a3af0744e9 Jul 02 14:48:21.191756 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.191737 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31468509_9602_47e0_a0b6_c441b943d622.slice/crio-7e8e0d766bd9d0c0669666b374d568f7f10e8bd75d5e992b648135f65228027b WatchSource:0}: Error finding container 7e8e0d766bd9d0c0669666b374d568f7f10e8bd75d5e992b648135f65228027b: Status 404 returned error can't find the container with id 7e8e0d766bd9d0c0669666b374d568f7f10e8bd75d5e992b648135f65228027b Jul 02 14:48:21.193089 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:21.193003 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda159d716_d59c_499c_80a4_68643dfed1d3.slice/crio-7670c0a8a2a8ce8abf573f6b21cae3c5b04ebdb1c09628d10e2fc81443bbab6a WatchSource:0}: Error finding container 7670c0a8a2a8ce8abf573f6b21cae3c5b04ebdb1c09628d10e2fc81443bbab6a: Status 404 returned error can't find the container with id 7670c0a8a2a8ce8abf573f6b21cae3c5b04ebdb1c09628d10e2fc81443bbab6a Jul 02 14:48:21.644545 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.644262 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:21.644545 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644542 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644571 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644585 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.644585 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644647 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:23.644627723 +0000 UTC m=+6.007445156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.644691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644713 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:21.644776 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644767 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:23.644749683 +0000 UTC m=+6.007567099 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:21.645141 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644782 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:21.645141 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:21.644820 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:23.644806914 +0000 UTC m=+6.007624334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:21.889593 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:21.889561 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 14:48:22.057327 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.057260 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 14:43:20 +0000 UTC" deadline="2027-11-29 03:00:55.962582951 +0000 UTC" Jul 02 14:48:22.057327 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.057325 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12348h12m33.905261488s" Jul 02 14:48:22.080387 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.080353 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:22.082756 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:22.082703 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:22.083031 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.083013 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:22.083139 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:22.083119 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:22.102616 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.102583 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" event={"ID":"ebed2cfefda3d3501e2c36adef46adbf","Type":"ContainerStarted","Data":"c6dc2efff6b40e5bce1f4020a9d52060a53a01014b9c5216c1710932312787b4"} Jul 02 14:48:22.108837 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.108807 2556 generic.go:356] "Generic (PLEG): container finished" podID="2840b7062d4a7fb57e53119467e5f890" containerID="b78677c913a256f8ef497ad57cadf7215f3dd5283607c0b55b4326b42b4c2f45" exitCode=0 Jul 02 14:48:22.108961 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.108891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" event={"ID":"2840b7062d4a7fb57e53119467e5f890","Type":"ContainerDied","Data":"b78677c913a256f8ef497ad57cadf7215f3dd5283607c0b55b4326b42b4c2f45"} Jul 02 14:48:22.133211 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.133158 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-199.ec2.internal" podStartSLOduration=3.133130278 podStartE2EDuration="3.133130278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:22.118455629 +0000 UTC m=+4.481273065" watchObservedRunningTime="2026-07-02 14:48:22.133130278 +0000 UTC m=+4.495947717" Jul 02 14:48:22.137684 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.137652 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" event={"ID":"e1247260-fc5c-43f7-8eac-f26ccaa31bef","Type":"ContainerStarted","Data":"d2905dbb2ba8a299312ef041cf41586c8e2be363df8a2fecab4325a3af0744e9"} Jul 02 14:48:22.149676 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.149110 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zh89" event={"ID":"a159d716-d59c-499c-80a4-68643dfed1d3","Type":"ContainerStarted","Data":"7670c0a8a2a8ce8abf573f6b21cae3c5b04ebdb1c09628d10e2fc81443bbab6a"} Jul 02 14:48:22.161708 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.161674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pgr9x" event={"ID":"31468509-9602-47e0-a0b6-c441b943d622","Type":"ContainerStarted","Data":"7e8e0d766bd9d0c0669666b374d568f7f10e8bd75d5e992b648135f65228027b"} Jul 02 14:48:22.176861 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.176776 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k56vv" event={"ID":"6ece0b50-4597-44e4-bcd1-75d36b7de366","Type":"ContainerStarted","Data":"86a62a4284a176623ec9e865ec08580f532a0e4bad3315268cd5dfe3313ae5db"} Jul 02 14:48:22.193896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.193796 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerStarted","Data":"56c50307ba0f9eacc92b74a91514382acbabffe8cf03dd3e9972c5739e6d4b67"} Jul 02 14:48:22.215740 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.215654 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h82zf" event={"ID":"5812f804-ea2f-4103-bc95-4841140f4fbe","Type":"ContainerStarted","Data":"1ce4d9d388b3aa4e2282ecbb0761b037f59462aa8da01832182894fe0d3f8042"} Jul 02 14:48:22.228564 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.228448 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vl9j" event={"ID":"62236a31-896b-491c-b2af-e4f2e0b25061","Type":"ContainerStarted","Data":"32803e4d5fb4cde5cb0d6943f545a46ac27c454c371a3bc8bf409734afa3d7c1"} Jul 02 14:48:22.240654 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.240563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh76s" event={"ID":"83aacf8c-2ff4-414f-9877-418f528d0e7c","Type":"ContainerStarted","Data":"82841163670bf50a4ca43e36297c1b0a501b315c6e084035faca22caeaf39f2f"} Jul 02 14:48:22.251656 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:22.251558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"cdd2f47b65348135c3948a699e0c7441b8a41d3f07eef89ece78a252d2dffc00"} Jul 02 14:48:23.080495 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:23.080452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:23.081166 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.080605 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:23.273757 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:23.273523 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" event={"ID":"2840b7062d4a7fb57e53119467e5f890","Type":"ContainerStarted","Data":"a0b32f2a480b05837459a3d32e1ff7288064ae74a2eae14bd5bbbe42ea3bf4f2"} Jul 02 14:48:23.663000 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:23.662959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:23.663193 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:23.663028 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:23.663193 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:23.663091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:23.663308 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663274 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:23.663358 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663350 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:27.66333113 +0000 UTC m=+10.026148548 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:23.663863 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663845 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:23.664040 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663871 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:23.664040 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663885 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:23.664040 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663930 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:27.663914789 +0000 UTC m=+10.026732209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:23.664040 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.663998 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:23.664040 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:23.664038 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:27.664019491 +0000 UTC m=+10.026836908 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:24.082816 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:24.082786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:24.083239 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:24.082980 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:24.083496 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:24.083477 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:24.083634 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:24.083612 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:25.080083 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:25.080051 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:25.080262 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:25.080178 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:26.081026 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:26.080346 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:26.081026 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:26.080484 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:26.081026 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:26.080864 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:26.081026 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:26.080975 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:27.080053 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:27.080012 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:27.080248 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.080151 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:27.695371 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:27.695323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:27.695401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:27.695449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695504 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695575 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:35.695555472 +0000 UTC m=+18.058372891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695639 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695664 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695677 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695643 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695729 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:35.695714812 +0000 UTC m=+18.058532226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:27.695829 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:27.695768 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:35.695751473 +0000 UTC m=+18.058568903 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:28.081202 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:28.080739 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:28.081202 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:28.080846 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:28.081202 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:28.080876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:28.081202 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:28.081000 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:29.080372 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:29.080337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:29.080822 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:29.080502 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:30.080688 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:30.080596 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:30.081147 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:30.080598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:30.081147 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:30.080735 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:30.081147 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:30.080820 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:31.080666 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:31.080629 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:31.080826 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:31.080756 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:32.080020 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:32.079990 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:32.080171 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:32.080121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:32.080229 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:32.080167 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:32.080318 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:32.080289 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:33.079981 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:33.079950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:33.080366 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:33.080070 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:34.080558 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:34.080518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:34.080995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:34.080518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:34.080995 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:34.080652 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:34.080995 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:34.080748 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:35.080175 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:35.080146 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:35.080363 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.080264 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:35.759301 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:35.759263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:35.759324 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:35.759361 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759430 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759488 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759493 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759513 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759525 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.759504685 +0000 UTC m=+34.122322102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759528 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759545 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.759534227 +0000 UTC m=+34.122351642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:35.759754 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:35.759564 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:48:51.759553786 +0000 UTC m=+34.122371219 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:36.080175 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:36.080130 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:36.080369 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:36.080180 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:36.080369 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:36.080292 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:36.080497 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:36.080364 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:37.080129 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:37.080093 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:37.080626 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:37.080250 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:38.081245 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:38.081206 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:38.081746 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:38.081311 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:38.081746 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:38.081366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:38.081746 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:38.081503 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:39.080061 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:39.080023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:39.080254 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:39.080146 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:40.080416 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.080180 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:40.080927 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.080277 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:40.080927 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:40.080564 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:40.080927 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:40.080660 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:40.308722 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.308497 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5zh89" event={"ID":"a159d716-d59c-499c-80a4-68643dfed1d3","Type":"ContainerStarted","Data":"ecbb73a68843cb7d64e8fb3c4886b2f673ee8c8f237a868a3fb6f63b80046709"} Jul 02 14:48:40.309969 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.309930 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pgr9x" event={"ID":"31468509-9602-47e0-a0b6-c441b943d622","Type":"ContainerStarted","Data":"25d38a810c0dd6547cff06e8ba2e02af81ee9372b9e958f61f8a204f671c8211"} Jul 02 14:48:40.311323 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.311300 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="00fce69bca8305de604cfef646a63e8e20e21073785564cfd3df8d8906b9e1be" exitCode=0 Jul 02 14:48:40.311420 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.311349 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"00fce69bca8305de604cfef646a63e8e20e21073785564cfd3df8d8906b9e1be"} Jul 02 14:48:40.312891 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.312826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h82zf" event={"ID":"5812f804-ea2f-4103-bc95-4841140f4fbe","Type":"ContainerStarted","Data":"bd6e37e599cd75ac4668f901009a3705d04528d5cb094ebe5fbf66fba0749178"} Jul 02 14:48:40.316788 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.316759 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9vl9j" event={"ID":"62236a31-896b-491c-b2af-e4f2e0b25061","Type":"ContainerStarted","Data":"4161614d7e3d2e895632ba5c0e72f881bcfbd0752492299ab23f12bc61d182b8"} Jul 02 14:48:40.318382 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.318357 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh76s" event={"ID":"83aacf8c-2ff4-414f-9877-418f528d0e7c","Type":"ContainerStarted","Data":"c9c17a0a4d5b2c65df068aa76b98839a23ae270ba756e8a678bf7c860115fa8d"} Jul 02 14:48:40.320796 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.320779 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:48:40.321144 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.321120 2556 generic.go:356] "Generic (PLEG): container finished" podID="4eb3595c-f569-4edd-98a3-1fa60e64dd50" containerID="573574f912759e43e95ee2002a58d5283430c993c015c957e47c698f90bf3932" exitCode=1 Jul 02 14:48:40.321221 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.321174 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"a8fd428d0fd4082816ce1b00d0a9aebc5d611472c184d661a1d9b4ae2dbda83e"} Jul 02 14:48:40.321271 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.321242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"0d205095e384f2f024ec2b1c2a9c86c58bf7954b7e0f54621bb098f10066c7d0"} Jul 02 14:48:40.321327 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.321295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerDied","Data":"573574f912759e43e95ee2002a58d5283430c993c015c957e47c698f90bf3932"} Jul 02 14:48:40.321363 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.321347 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"69f6a3ed06f76a9edb2b54e9fa3b5fa8617664debb1a9f430497f58046ed31e9"} Jul 02 14:48:40.322490 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.322457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" event={"ID":"e1247260-fc5c-43f7-8eac-f26ccaa31bef","Type":"ContainerStarted","Data":"bec1b01c419f99da45688ce84acf95aa62d9610b501569aa513098cf25401f95"} Jul 02 14:48:40.326660 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.326623 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5zh89" podStartSLOduration=3.7387185130000002 podStartE2EDuration="22.326612613s" totalImagesPullingTime="18.5878941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:40.326091623 +0000 UTC m=+22.688909060" watchObservedRunningTime="2026-07-02 14:48:40.326612613 +0000 UTC m=+22.689430048" Jul 02 14:48:40.326831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.326805 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-199.ec2.internal" podStartSLOduration=21.326799521 podStartE2EDuration="21.326799521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:23.289310149 +0000 UTC m=+5.652127585" watchObservedRunningTime="2026-07-02 14:48:40.326799521 +0000 UTC m=+22.689616956" Jul 02 14:48:40.361518 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.361475 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h82zf" podStartSLOduration=3.764562458 podStartE2EDuration="22.361444413s" totalImagesPullingTime="18.596881955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:40.344079811 +0000 UTC m=+22.706897247" watchObservedRunningTime="2026-07-02 14:48:40.361444413 +0000 UTC m=+22.724261829" Jul 02 14:48:40.361819 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.361785 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9vl9j" podStartSLOduration=3.711198456 podStartE2EDuration="22.361775833s" totalImagesPullingTime="18.650577377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:40.361011901 +0000 UTC m=+22.723829337" watchObservedRunningTime="2026-07-02 14:48:40.361775833 +0000 UTC m=+22.724593270" Jul 02 14:48:40.395137 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.395096 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pgr9x" podStartSLOduration=3.800676641 podStartE2EDuration="22.395084336s" totalImagesPullingTime="18.594407695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:40.394871733 +0000 UTC m=+22.757689170" watchObservedRunningTime="2026-07-02 14:48:40.395084336 +0000 UTC m=+22.757901750" Jul 02 14:48:40.408245 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:40.408208 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xh76s" podStartSLOduration=3.810283633 podStartE2EDuration="22.408196324s" totalImagesPullingTime="18.597912691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:40.407759062 +0000 UTC m=+22.770576499" watchObservedRunningTime="2026-07-02 14:48:40.408196324 +0000 UTC m=+22.771013760" Jul 02 14:48:41.080456 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.080383 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:41.081150 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:41.080525 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:41.100138 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.100108 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:41.100831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.100806 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:41.326885 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.326856 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k56vv" event={"ID":"6ece0b50-4597-44e4-bcd1-75d36b7de366","Type":"ContainerStarted","Data":"17c0d8d3e104adddb965faaf6819331024e764062c207923ec4043091fb42105"} Jul 02 14:48:41.330232 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.330210 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:48:41.330649 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.330577 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"fcf98c7e538a1cd94b5de479b2a241032bb7eec022b7f46db251a2ec61ad5744"} Jul 02 14:48:41.330748 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.330655 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"f3a3fe909d3850c200f8bf38a1c4fa5673587b5f9fcf40fd198c4f2069908673"} Jul 02 14:48:41.340169 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.340118 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k56vv" podStartSLOduration=4.7478318250000004 podStartE2EDuration="23.340104827s" totalImagesPullingTime="18.592273002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:41.339966816 +0000 UTC m=+23.702784254" watchObservedRunningTime="2026-07-02 14:48:41.340104827 +0000 UTC m=+23.702922263" Jul 02 14:48:41.349672 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.349644 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 14:48:41.652743 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.652646 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:41.653213 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:41.653194 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h82zf" Jul 02 14:48:42.080618 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.080502 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T14:48:41.349666589Z","UUID":"38e202ae-9386-43a9-8943-a989bfd04772","Handler":null,"Name":"","Endpoint":""} Jul 02 14:48:42.080618 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.080606 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:42.081246 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.080633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:42.081246 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:42.080712 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:42.081246 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:42.080900 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:42.082421 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.082395 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 14:48:42.082595 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.082443 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 14:48:42.335643 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:42.335556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" event={"ID":"e1247260-fc5c-43f7-8eac-f26ccaa31bef","Type":"ContainerStarted","Data":"44cb1a8cec8dad8ca8b13b66ac132235096fc2d0668d1fc95abf3f0335c58fa7"} Jul 02 14:48:43.079915 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:43.079888 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:43.080086 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:43.079997 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:43.341185 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:43.341117 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:48:43.341637 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:43.341603 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"9e57a49e9cf4cb8b2a500a50baed43aa045726e96eba9539a45c05187b44c202"} Jul 02 14:48:44.080250 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:44.080218 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:44.080431 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:44.080220 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:44.080431 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:44.080359 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:44.080431 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:44.080421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:45.080261 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.080090 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:45.080928 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:45.080338 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:45.348270 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.348178 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" event={"ID":"e1247260-fc5c-43f7-8eac-f26ccaa31bef","Type":"ContainerStarted","Data":"3847f5d95453c5ece2ad517c2bcced4f7403efea2e4fc40ce8d33ad8cede6fd9"} Jul 02 14:48:45.349829 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.349806 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="8969e292a0b3556d67cbd85c2b63aa41557684e1297bf45d2b82aee350c64409" exitCode=0 Jul 02 14:48:45.349950 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.349884 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"8969e292a0b3556d67cbd85c2b63aa41557684e1297bf45d2b82aee350c64409"} Jul 02 14:48:45.353193 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353177 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:48:45.353556 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"0032a0c17b2dd2a87697e9088bd783af96d7dd7620d7bcb57f9efdf0ff5731a9"} Jul 02 14:48:45.353844 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353814 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:45.353921 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353863 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:45.353921 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353909 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:45.354021 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.353967 2556 scope.go:117] "RemoveContainer" containerID="573574f912759e43e95ee2002a58d5283430c993c015c957e47c698f90bf3932" Jul 02 14:48:45.366380 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.366331 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tm6dn" podStartSLOduration=4.258871441 podStartE2EDuration="27.366314921s" totalImagesPullingTime="23.10744348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:45.365979252 +0000 UTC m=+27.728796687" watchObservedRunningTime="2026-07-02 14:48:45.366314921 +0000 UTC m=+27.729132358" Jul 02 14:48:45.369223 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.369197 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:45.370276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:45.370257 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:48:46.079770 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.079738 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:46.079974 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:46.079863 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:46.079974 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.079908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:46.080087 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:46.079999 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:46.359883 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.359655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:48:46.360249 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.360223 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" event={"ID":"4eb3595c-f569-4edd-98a3-1fa60e64dd50","Type":"ContainerStarted","Data":"d2c53300719b7e002ef576110106b99d12ccdf40267feb4f70ca589f32230502"} Jul 02 14:48:46.394033 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.393851 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" podStartSLOduration=9.720421156 podStartE2EDuration="28.393836603s" totalImagesPullingTime="18.673415447s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:46.392601863 +0000 UTC m=+28.755419312" watchObservedRunningTime="2026-07-02 14:48:46.393836603 +0000 UTC m=+28.756654038" Jul 02 14:48:46.913558 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.913525 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxgv7"] Jul 02 14:48:46.913732 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.913688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:46.913822 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:46.913794 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:46.916427 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.916395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pls7k"] Jul 02 14:48:46.916578 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.916530 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:46.916672 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:46.916648 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:46.929692 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.929662 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mrw9"] Jul 02 14:48:46.929809 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:46.929751 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:46.929849 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:46.929824 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:47.364570 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:47.364525 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="16e435376d5b192fea549714b5c7da21760a328dcc3b70ba20132d7ed482b7a8" exitCode=0 Jul 02 14:48:47.364570 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:47.364564 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"16e435376d5b192fea549714b5c7da21760a328dcc3b70ba20132d7ed482b7a8"} Jul 02 14:48:48.080958 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:48.080930 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:48.081144 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:48.081053 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:49.080297 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:49.080266 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:49.080769 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:49.080266 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:49.080769 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:49.080380 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:49.080769 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:49.080424 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:49.370849 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:49.370760 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="2c456fac8f2168b1b45251cd3acb74e4f041647b884efd99729bd109d6f71068" exitCode=0 Jul 02 14:48:49.370849 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:49.370825 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"2c456fac8f2168b1b45251cd3acb74e4f041647b884efd99729bd109d6f71068"} Jul 02 14:48:50.079895 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:50.079867 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:50.080079 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:50.079997 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:51.079950 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:51.079916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:51.079950 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:51.079949 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:51.080402 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.080056 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:51.080402 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.080176 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:51.776506 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:51.776411 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:51.776506 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:51.776483 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:51.776522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776579 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776623 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776627 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776649 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776651 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret podName:cd1bac5c-4bd8-4cf7-8636-16934550df45 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:23.776631486 +0000 UTC m=+66.139448925 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret") pod "global-pull-secret-syncer-9mrw9" (UID: "cd1bac5c-4bd8-4cf7-8636-16934550df45") : object "kube-system"/"original-pull-secret" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776662 2556 projected.go:196] Error preparing data for projected volume kube-api-access-ch6pc for pod openshift-network-diagnostics/network-check-target-cxgv7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776674 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:49:23.776663199 +0000 UTC m=+66.139480621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 14:48:51.776724 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:51.776711 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc podName:7179404a-716d-493c-8204-16c335768d4c nodeName:}" failed. No retries permitted until 2026-07-02 14:49:23.77669457 +0000 UTC m=+66.139511986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ch6pc" (UniqueName: "kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc") pod "network-check-target-cxgv7" (UID: "7179404a-716d-493c-8204-16c335768d4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 14:48:52.079923 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:52.079716 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:52.080098 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:52.080044 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:48:53.080641 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.080604 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:53.080641 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.080634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:53.081143 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.080710 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mrw9" podUID="cd1bac5c-4bd8-4cf7-8636-16934550df45" Jul 02 14:48:53.081143 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.080791 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cxgv7" podUID="7179404a-716d-493c-8204-16c335768d4c" Jul 02 14:48:53.414682 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.414661 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-199.ec2.internal" event="NodeReady" Jul 02 14:48:53.414795 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.414783 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 14:48:53.456267 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.456239 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:48:53.461111 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.461085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.463148 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.463129 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 14:48:53.463282 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.463265 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj2f4\"" Jul 02 14:48:53.463751 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.463733 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 14:48:53.463943 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.463927 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 14:48:53.469755 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.469733 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 14:48:53.474727 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.474708 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zf4zq"] Jul 02 14:48:53.476534 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.476518 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mb7rb"] Jul 02 14:48:53.476675 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.476655 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.478181 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.478161 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.479866 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.479850 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 14:48:53.479977 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.479962 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:48:53.480233 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.480219 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 14:48:53.480308 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.480286 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 14:48:53.480640 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.480603 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 14:48:53.480640 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.480626 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 14:48:53.480908 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.480896 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xpgfg\"" Jul 02 14:48:53.488087 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.488035 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:48:53.496309 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.496231 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mb7rb"] Jul 02 14:48:53.502103 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.502060 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zf4zq"] Jul 02 14:48:53.591765 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591742 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.591868 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-tmp-dir\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.591868 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.591943 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591866 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc48n\" (UniqueName: \"kubernetes.io/projected/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-kube-api-access-qc48n\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.591988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.591988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592058 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.591997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592058 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c466dd-a352-40cd-8551-15281b2cf831-cert\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.592058 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592061 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592078 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nb6m\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592093 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-config-volume\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.592149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.592149 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.592125 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbc6\" (UniqueName: \"kubernetes.io/projected/46c466dd-a352-40cd-8551-15281b2cf831-kube-api-access-fmbc6\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.692724 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.692724 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692672 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-tmp-dir\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.692724 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692691 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc48n\" (UniqueName: \"kubernetes.io/projected/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-kube-api-access-qc48n\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692769 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.692797 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692810 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.692819 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692834 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c466dd-a352-40cd-8551-15281b2cf831-cert\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.692868 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.692898 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:48:54.192877666 +0000 UTC m=+36.555695099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:53.692937 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:54.192914428 +0000 UTC m=+36.555731842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:48:53.692976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.692976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693054 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-tmp-dir\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nb6m\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-config-volume\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbc6\" (UniqueName: \"kubernetes.io/projected/46c466dd-a352-40cd-8551-15281b2cf831-kube-api-access-fmbc6\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.693544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693353 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.693853 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693762 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-config-volume\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.693853 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.693823 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.694455 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.694437 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.696946 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.696920 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.697074 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.697000 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.697074 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.697046 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46c466dd-a352-40cd-8551-15281b2cf831-cert\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.700817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.700789 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.700998 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.700874 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nb6m\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:53.701067 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.701012 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc48n\" (UniqueName: \"kubernetes.io/projected/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-kube-api-access-qc48n\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:53.701967 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.701933 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbc6\" (UniqueName: \"kubernetes.io/projected/46c466dd-a352-40cd-8551-15281b2cf831-kube-api-access-fmbc6\") pod \"ingress-canary-mb7rb\" (UID: \"46c466dd-a352-40cd-8551-15281b2cf831\") " pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.795133 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.795097 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mb7rb" Jul 02 14:48:53.925282 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:53.925252 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mb7rb"] Jul 02 14:48:53.928699 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:48:53.928676 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c466dd_a352_40cd_8551_15281b2cf831.slice/crio-b5f7bae56e3b09c66198dd9beb154305c22147bcaa71806ef9f0acb1878b8df9 WatchSource:0}: Error finding container b5f7bae56e3b09c66198dd9beb154305c22147bcaa71806ef9f0acb1878b8df9: Status 404 returned error can't find the container with id b5f7bae56e3b09c66198dd9beb154305c22147bcaa71806ef9f0acb1878b8df9 Jul 02 14:48:54.080519 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.080484 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:48:54.082894 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.082869 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:48:54.083495 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.083001 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:48:54.197557 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.197520 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:54.197557 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.197557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:54.197807 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:54.197641 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:54.197807 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:54.197663 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:54.197807 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:54.197680 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:48:54.197807 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:54.197685 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:55.197673299 +0000 UTC m=+37.560490713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:48:54.197807 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:54.197723 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:48:55.197708797 +0000 UTC m=+37.560526231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:48:54.386757 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.386665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mb7rb" event={"ID":"46c466dd-a352-40cd-8551-15281b2cf831","Type":"ContainerStarted","Data":"b5f7bae56e3b09c66198dd9beb154305c22147bcaa71806ef9f0acb1878b8df9"} Jul 02 14:48:54.389992 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.389962 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="94d1467dca499ef633fbd99c95a04b536947f31f85cb63bf32759000cb3fbb3d" exitCode=0 Jul 02 14:48:54.390130 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:54.389999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"94d1467dca499ef633fbd99c95a04b536947f31f85cb63bf32759000cb3fbb3d"} Jul 02 14:48:55.080859 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.080634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:48:55.081499 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.080634 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:48:55.083481 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.083446 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:48:55.083855 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.083453 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:48:55.083855 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.083553 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:48:55.083855 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.083803 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:48:55.205605 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.205577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:55.205605 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.205607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:55.205848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:55.205747 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:55.205848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:55.205767 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:48:55.205848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:55.205769 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:55.205848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:55.205818 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:48:57.205805443 +0000 UTC m=+39.568622857 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:48:55.205848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:55.205831 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:48:57.205825787 +0000 UTC m=+39.568643214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:48:55.395831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.395744 2556 generic.go:356] "Generic (PLEG): container finished" podID="dd9c66a5-dc2d-4e26-a947-cdf802303f3d" containerID="1ea9b2ffff9b9202b60bf7368f155692ac67efde763e30b63cf3e61736f53c82" exitCode=0 Jul 02 14:48:55.395831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:55.395785 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerDied","Data":"1ea9b2ffff9b9202b60bf7368f155692ac67efde763e30b63cf3e61736f53c82"} Jul 02 14:48:56.399904 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:56.399867 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mb7rb" event={"ID":"46c466dd-a352-40cd-8551-15281b2cf831","Type":"ContainerStarted","Data":"17d850cda9bffea45cf1227df6b39a3ede16f495d7e76338fe5589d6172d7ce5"} Jul 02 14:48:56.403593 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:56.403569 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7knw" event={"ID":"dd9c66a5-dc2d-4e26-a947-cdf802303f3d","Type":"ContainerStarted","Data":"5d808947a314cd7e7ab84c40b3c6781ab6dee9131c704507f89cc5167b627d5a"} Jul 02 14:48:56.415824 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:56.415656 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mb7rb" podStartSLOduration=1.176629122 podStartE2EDuration="3.415638035s" totalImagesPullingTime="2.239008913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:56.414602672 +0000 UTC m=+38.777420110" watchObservedRunningTime="2026-07-02 14:48:56.415638035 +0000 UTC m=+38.778455472" Jul 02 14:48:56.437479 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:56.437421 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w7knw" podStartSLOduration=9.291129331 podStartE2EDuration="38.437405999s" totalImagesPullingTime="29.146276668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:48:56.436669185 +0000 UTC m=+38.799486623" watchObservedRunningTime="2026-07-02 14:48:56.437405999 +0000 UTC m=+38.800223413" Jul 02 14:48:57.220097 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:57.220055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:48:57.220271 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:48:57.220116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:48:57.220271 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:57.220205 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:48:57.220271 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:57.220226 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:48:57.220373 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:57.220272 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:48:57.220373 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:57.220283 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:49:01.220269124 +0000 UTC m=+43.583086539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:48:57.220373 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:48:57.220324 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:01.220310828 +0000 UTC m=+43.583128243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:49:01.247483 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:01.247282 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:01.247504 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:01.247450 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:01.247565 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:01.247663 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:49:09.247644358 +0000 UTC m=+51.610461773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:01.247690 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:01.247890 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:01.247745 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:09.24773086 +0000 UTC m=+51.610548273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:49:09.304868 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:09.304824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:49:09.304868 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:09.304868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:49:09.305391 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:09.304985 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:09.305391 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:09.304999 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:09.305391 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:09.305002 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:49:09.305391 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:09.305063 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:49:25.305046267 +0000 UTC m=+67.667863680 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:49:09.305391 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:09.305076 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:25.305069904 +0000 UTC m=+67.667887318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:49:17.380180 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:17.380147 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-smsbw" Jul 02 14:49:23.807816 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.807764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:49:23.807816 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.807828 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:49:23.808357 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.807863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:49:23.809968 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.809947 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 14:49:23.810060 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.810041 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 14:49:23.810117 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.810044 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 14:49:23.818598 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:23.818574 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:49:23.818685 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:23.818676 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:50:27.818661338 +0000 UTC m=+130.181478756 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : secret "metrics-daemon-secret" not found Jul 02 14:49:23.820141 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.820125 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 14:49:23.822250 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.822231 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd1bac5c-4bd8-4cf7-8636-16934550df45-original-pull-secret\") pod \"global-pull-secret-syncer-9mrw9\" (UID: \"cd1bac5c-4bd8-4cf7-8636-16934550df45\") " pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:49:23.831167 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.831143 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6pc\" (UniqueName: \"kubernetes.io/projected/7179404a-716d-493c-8204-16c335768d4c-kube-api-access-ch6pc\") pod \"network-check-target-cxgv7\" (UID: \"7179404a-716d-493c-8204-16c335768d4c\") " pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:49:23.894112 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.894090 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rrv2x\"" Jul 02 14:49:23.897706 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.897692 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mrw9" Jul 02 14:49:23.902812 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:23.902791 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:49:24.041087 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:24.041052 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mrw9"] Jul 02 14:49:24.044620 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:49:24.044594 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1bac5c_4bd8_4cf7_8636_16934550df45.slice/crio-d8c39d2d4c28a6596832df4a8471f912209e0a4e29d4e34d79329d4f2b206f8b WatchSource:0}: Error finding container d8c39d2d4c28a6596832df4a8471f912209e0a4e29d4e34d79329d4f2b206f8b: Status 404 returned error can't find the container with id d8c39d2d4c28a6596832df4a8471f912209e0a4e29d4e34d79329d4f2b206f8b Jul 02 14:49:24.058889 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:24.058829 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cxgv7"] Jul 02 14:49:24.061598 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:49:24.061573 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7179404a_716d_493c_8204_16c335768d4c.slice/crio-95633b44d29ac08452026c9491e2246b2230cca2fcf0c39ceac59e15ff67371c WatchSource:0}: Error finding container 95633b44d29ac08452026c9491e2246b2230cca2fcf0c39ceac59e15ff67371c: Status 404 returned error can't find the container with id 95633b44d29ac08452026c9491e2246b2230cca2fcf0c39ceac59e15ff67371c Jul 02 14:49:24.469783 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:24.469746 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxgv7" event={"ID":"7179404a-716d-493c-8204-16c335768d4c","Type":"ContainerStarted","Data":"95633b44d29ac08452026c9491e2246b2230cca2fcf0c39ceac59e15ff67371c"} Jul 02 14:49:24.470945 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:24.470921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mrw9" event={"ID":"cd1bac5c-4bd8-4cf7-8636-16934550df45","Type":"ContainerStarted","Data":"d8c39d2d4c28a6596832df4a8471f912209e0a4e29d4e34d79329d4f2b206f8b"} Jul 02 14:49:25.318989 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:25.318944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:25.318997 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:25.319134 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:25.319147 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:25.319170 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:25.319191 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:49:57.319173953 +0000 UTC m=+99.681991367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:49:25.319517 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:25.319226 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:49:57.319207248 +0000 UTC m=+99.682024679 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:49:29.485481 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:29.485444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cxgv7" event={"ID":"7179404a-716d-493c-8204-16c335768d4c","Type":"ContainerStarted","Data":"9af2489f0ec553910f4419eba1cc3ebc1d642bf5d42b722114ab82a962c30dba"} Jul 02 14:49:29.485937 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:29.485530 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:49:29.486840 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:29.486817 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mrw9" event={"ID":"cd1bac5c-4bd8-4cf7-8636-16934550df45","Type":"ContainerStarted","Data":"70aaa06dafe8deeb3843963c2d51272521886446d9b94de1b4e17b396aee1b01"} Jul 02 14:49:29.499127 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:29.499088 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cxgv7" podStartSLOduration=66.971209233 podStartE2EDuration="1m11.499075276s" totalImagesPullingTime="4.527866043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:29.498511849 +0000 UTC m=+71.861329285" watchObservedRunningTime="2026-07-02 14:49:29.499075276 +0000 UTC m=+71.861892690" Jul 02 14:49:29.513849 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:29.513806 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9mrw9" podStartSLOduration=66.966293176 podStartE2EDuration="1m11.513793278s" totalImagesPullingTime="4.547500102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:49:29.513576247 +0000 UTC m=+71.876393695" watchObservedRunningTime="2026-07-02 14:49:29.513793278 +0000 UTC m=+71.876610692" Jul 02 14:49:57.343834 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:57.343788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:49:57.343834 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:49:57.343830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:49:57.344286 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:57.343946 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:49:57.344286 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:57.343965 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:49:57.344286 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:57.343990 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:49:57.344286 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:57.344019 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:51:01.344003074 +0000 UTC m=+163.706820488 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:49:57.344286 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:49:57.344041 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:51:01.344029822 +0000 UTC m=+163.706847237 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:50:00.491785 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:50:00.491746 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cxgv7" Jul 02 14:50:27.860108 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:50:27.860060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:50:27.860629 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:50:27.860212 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:50:27.860629 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:50:27.860286 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:52:29.860269493 +0000 UTC m=+252.223086907 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : secret "metrics-daemon-secret" not found Jul 02 14:50:56.473151 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:50:56.473107 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" Jul 02 14:50:56.488348 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:50:56.488315 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zf4zq" podUID="5a99a7d6-9f0e-42f2-80fe-b63255a41f78" Jul 02 14:50:56.699313 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:50:56.699289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:50:56.699482 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:50:56.699289 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:50:57.089834 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:50:57.089793 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:51:01.396518 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:51:01.396477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:51:01.396518 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:51:01.396519 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:51:01.397076 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:51:01.396620 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 14:51:01.397076 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:51:01.396641 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-755f8bbdd7-bw4t8: secret "image-registry-tls" not found Jul 02 14:51:01.397076 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:51:01.396708 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls podName:6fddff71-da0b-472e-b369-d3b3b4456dfa nodeName:}" failed. No retries permitted until 2026-07-02 14:53:03.396682159 +0000 UTC m=+285.759499578 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls") pod "image-registry-755f8bbdd7-bw4t8" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa") : secret "image-registry-tls" not found Jul 02 14:51:01.397076 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:51:01.396629 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 14:51:01.397076 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:51:01.396766 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls podName:5a99a7d6-9f0e-42f2-80fe-b63255a41f78 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:03.396746987 +0000 UTC m=+285.759564424 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls") pod "dns-default-zf4zq" (UID: "5a99a7d6-9f0e-42f2-80fe-b63255a41f78") : secret "dns-default-metrics-tls" not found Jul 02 14:51:10.080648 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:51:10.080560 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:52:29.909222 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:29.909185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:52:29.909720 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:29.909332 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 14:52:29.909720 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:29.909399 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs podName:2ca7704b-8f91-4c64-8f35-0f295d28debd nodeName:}" failed. No retries permitted until 2026-07-02 14:54:31.909382096 +0000 UTC m=+374.272199510 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs") pod "network-metrics-daemon-pls7k" (UID: "2ca7704b-8f91-4c64-8f35-0f295d28debd") : secret "metrics-daemon-secret" not found Jul 02 14:52:44.100898 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.100811 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8"] Jul 02 14:52:44.102991 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.102974 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" Jul 02 14:52:44.105010 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.104988 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tlrmt\"" Jul 02 14:52:44.105198 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.105163 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.105621 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.105607 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.138459 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.138426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8"] Jul 02 14:52:44.202236 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.202204 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-f24dp"] Jul 02 14:52:44.204209 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.204185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" Jul 02 14:52:44.205852 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.205830 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-lf59p"] Jul 02 14:52:44.206198 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.206181 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t9bvr\"" Jul 02 14:52:44.207594 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.207581 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.208179 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.208151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gjl5\" (UniqueName: \"kubernetes.io/projected/87f2b6d6-b7d9-47fb-af67-c6b3f376adcf-kube-api-access-5gjl5\") pod \"volume-data-source-validator-69d9f679db-7r5g8\" (UID: \"87f2b6d6-b7d9-47fb-af67-c6b3f376adcf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" Jul 02 14:52:44.209777 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.209759 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 14:52:44.210152 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.210130 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 14:52:44.210242 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.210197 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 14:52:44.213818 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.213797 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bdflf\"" Jul 02 14:52:44.213919 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.213799 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 14:52:44.217950 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.217931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-f24dp"] Jul 02 14:52:44.218516 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.218500 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 14:52:44.222931 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.222910 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-lf59p"] Jul 02 14:52:44.308682 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-snapshots\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308832 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308699 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-service-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308832 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308740 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308832 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308762 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhmhq\" (UniqueName: \"kubernetes.io/projected/c6ef8365-6029-4680-9e16-6668a6c043a8-kube-api-access-zhmhq\") pod \"network-check-source-56499946bc-f24dp\" (UID: \"c6ef8365-6029-4680-9e16-6668a6c043a8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" Jul 02 14:52:44.308832 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-tmp\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308963 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/718fb371-8599-401e-abe1-54124f3244fa-serving-cert\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308963 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308861 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zgt\" (UniqueName: \"kubernetes.io/projected/718fb371-8599-401e-abe1-54124f3244fa-kube-api-access-v2zgt\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.308963 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.308921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gjl5\" (UniqueName: \"kubernetes.io/projected/87f2b6d6-b7d9-47fb-af67-c6b3f376adcf-kube-api-access-5gjl5\") pod \"volume-data-source-validator-69d9f679db-7r5g8\" (UID: \"87f2b6d6-b7d9-47fb-af67-c6b3f376adcf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" Jul 02 14:52:44.316224 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.316197 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gjl5\" (UniqueName: \"kubernetes.io/projected/87f2b6d6-b7d9-47fb-af67-c6b3f376adcf-kube-api-access-5gjl5\") pod \"volume-data-source-validator-69d9f679db-7r5g8\" (UID: \"87f2b6d6-b7d9-47fb-af67-c6b3f376adcf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" Jul 02 14:52:44.409495 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409405 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-snapshots\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.409495 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409447 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-service-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.409670 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409596 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.409670 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409625 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhmhq\" (UniqueName: \"kubernetes.io/projected/c6ef8365-6029-4680-9e16-6668a6c043a8-kube-api-access-zhmhq\") pod \"network-check-source-56499946bc-f24dp\" (UID: \"c6ef8365-6029-4680-9e16-6668a6c043a8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" Jul 02 14:52:44.409670 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-tmp\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.409789 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409696 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/718fb371-8599-401e-abe1-54124f3244fa-serving-cert\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.409789 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.409727 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zgt\" (UniqueName: \"kubernetes.io/projected/718fb371-8599-401e-abe1-54124f3244fa-kube-api-access-v2zgt\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.410082 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.410049 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-tmp\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.410082 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.410076 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-service-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.410236 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.410077 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/718fb371-8599-401e-abe1-54124f3244fa-snapshots\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.410387 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.410370 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718fb371-8599-401e-abe1-54124f3244fa-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.411216 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.411197 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" Jul 02 14:52:44.412604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.412584 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/718fb371-8599-401e-abe1-54124f3244fa-serving-cert\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.417456 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.417413 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhmhq\" (UniqueName: \"kubernetes.io/projected/c6ef8365-6029-4680-9e16-6668a6c043a8-kube-api-access-zhmhq\") pod \"network-check-source-56499946bc-f24dp\" (UID: \"c6ef8365-6029-4680-9e16-6668a6c043a8\") " pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" Jul 02 14:52:44.417562 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.417457 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zgt\" (UniqueName: \"kubernetes.io/projected/718fb371-8599-401e-abe1-54124f3244fa-kube-api-access-v2zgt\") pod \"insights-operator-5f67b55555-lf59p\" (UID: \"718fb371-8599-401e-abe1-54124f3244fa\") " pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.514272 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.514243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" Jul 02 14:52:44.519495 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.519457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-lf59p" Jul 02 14:52:44.528107 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.527987 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8"] Jul 02 14:52:44.530420 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:52:44.530396 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f2b6d6_b7d9_47fb_af67_c6b3f376adcf.slice/crio-39d9607b30abb71caac47bd9a9cce1312dafa189b65f29ae43c4d1b4a90674ae WatchSource:0}: Error finding container 39d9607b30abb71caac47bd9a9cce1312dafa189b65f29ae43c4d1b4a90674ae: Status 404 returned error can't find the container with id 39d9607b30abb71caac47bd9a9cce1312dafa189b65f29ae43c4d1b4a90674ae Jul 02 14:52:44.642580 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.642552 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-56499946bc-f24dp"] Jul 02 14:52:44.645392 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:52:44.645368 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6ef8365_6029_4680_9e16_6668a6c043a8.slice/crio-8af5aa036a3bcad51ea004cce5cf5ebd2f0341877eb9327a4a349cc83d25781c WatchSource:0}: Error finding container 8af5aa036a3bcad51ea004cce5cf5ebd2f0341877eb9327a4a349cc83d25781c: Status 404 returned error can't find the container with id 8af5aa036a3bcad51ea004cce5cf5ebd2f0341877eb9327a4a349cc83d25781c Jul 02 14:52:44.658359 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.658341 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-lf59p"] Jul 02 14:52:44.661056 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:52:44.661005 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718fb371_8599_401e_abe1_54124f3244fa.slice/crio-091a9c4b7aa0dfdf41ff9de5f4f4d457655038cf4743857cd1c014f582d80b89 WatchSource:0}: Error finding container 091a9c4b7aa0dfdf41ff9de5f4f4d457655038cf4743857cd1c014f582d80b89: Status 404 returned error can't find the container with id 091a9c4b7aa0dfdf41ff9de5f4f4d457655038cf4743857cd1c014f582d80b89 Jul 02 14:52:44.942986 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.942893 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" event={"ID":"87f2b6d6-b7d9-47fb-af67-c6b3f376adcf","Type":"ContainerStarted","Data":"39d9607b30abb71caac47bd9a9cce1312dafa189b65f29ae43c4d1b4a90674ae"} Jul 02 14:52:44.944004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.943978 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-lf59p" event={"ID":"718fb371-8599-401e-abe1-54124f3244fa","Type":"ContainerStarted","Data":"091a9c4b7aa0dfdf41ff9de5f4f4d457655038cf4743857cd1c014f582d80b89"} Jul 02 14:52:44.945361 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.945333 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" event={"ID":"c6ef8365-6029-4680-9e16-6668a6c043a8","Type":"ContainerStarted","Data":"9ff90d331ff9ba152bb47021e5d611939c103e65f45c630e2f3ed2462a798a45"} Jul 02 14:52:44.945447 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.945377 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" event={"ID":"c6ef8365-6029-4680-9e16-6668a6c043a8","Type":"ContainerStarted","Data":"8af5aa036a3bcad51ea004cce5cf5ebd2f0341877eb9327a4a349cc83d25781c"} Jul 02 14:52:44.960494 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:44.960433 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-56499946bc-f24dp" podStartSLOduration=0.96041656 podStartE2EDuration="960.41656ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:44.959579943 +0000 UTC m=+267.322397380" watchObservedRunningTime="2026-07-02 14:52:44.96041656 +0000 UTC m=+267.323233999" Jul 02 14:52:45.950766 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:45.950734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" event={"ID":"87f2b6d6-b7d9-47fb-af67-c6b3f376adcf","Type":"ContainerStarted","Data":"7a81788a72118e44e3747406d0d37c3d6a49c17f44e169f0c6580d776ee870d8"} Jul 02 14:52:45.965352 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:45.965307 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-7r5g8" podStartSLOduration=0.621870701 podStartE2EDuration="1.965292505s" totalImagesPullingTime="1.343421804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:45.964592094 +0000 UTC m=+268.327409532" watchObservedRunningTime="2026-07-02 14:52:45.965292505 +0000 UTC m=+268.328109941" Jul 02 14:52:47.957501 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:47.957455 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-lf59p" event={"ID":"718fb371-8599-401e-abe1-54124f3244fa","Type":"ContainerStarted","Data":"db130474ef1623e3c7e7c14aa1c36ce0a5b23ff41130f8c9e1f5a5d0a7b230df"} Jul 02 14:52:47.980530 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:47.980457 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-lf59p" podStartSLOduration=1.503512097 podStartE2EDuration="3.980435549s" totalImagesPullingTime="2.476923452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:47.980168189 +0000 UTC m=+270.342985637" watchObservedRunningTime="2026-07-02 14:52:47.980435549 +0000 UTC m=+270.343252986" Jul 02 14:52:48.487006 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.486972 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wfj6f"] Jul 02 14:52:48.489418 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.489401 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.491961 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.491938 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 14:52:48.492075 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.492057 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 14:52:48.492609 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.492595 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9m28\"" Jul 02 14:52:48.511840 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.511819 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfj6f"] Jul 02 14:52:48.541199 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.541170 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79dd1e91-02b6-437a-8402-34458a1095bf-data-volume\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.541297 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.541218 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.541297 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.541242 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqjr\" (UniqueName: \"kubernetes.io/projected/79dd1e91-02b6-437a-8402-34458a1095bf-kube-api-access-9mqjr\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.541297 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.541257 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.541417 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.541352 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79dd1e91-02b6-437a-8402-34458a1095bf-crio-socket\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.642663 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.642632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79dd1e91-02b6-437a-8402-34458a1095bf-data-volume\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.642816 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.642678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.642816 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.642704 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqjr\" (UniqueName: \"kubernetes.io/projected/79dd1e91-02b6-437a-8402-34458a1095bf-kube-api-access-9mqjr\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.642886 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:48.642852 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.642923 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:48.642910 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.14289219 +0000 UTC m=+271.505709611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:48.642980 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.642949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.643015 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:48.643000 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:48.643071 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.643058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79dd1e91-02b6-437a-8402-34458a1095bf-crio-socket\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.643105 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.642954 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/79dd1e91-02b6-437a-8402-34458a1095bf-data-volume\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.643105 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:48.643079 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:49.143062253 +0000 UTC m=+271.505879668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : configmap "kube-rbac-proxy" not found Jul 02 14:52:48.643172 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.643118 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/79dd1e91-02b6-437a-8402-34458a1095bf-crio-socket\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:48.651486 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:48.651436 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqjr\" (UniqueName: \"kubernetes.io/projected/79dd1e91-02b6-437a-8402-34458a1095bf-kube-api-access-9mqjr\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:49.147135 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.147092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:49.147536 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.147194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:49.147536 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:49.147241 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:49.147536 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:49.147280 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.147536 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:49.147308 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.147292638 +0000 UTC m=+272.510110051 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : configmap "kube-rbac-proxy" not found Jul 02 14:52:49.147536 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:49.147323 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:50.147316888 +0000 UTC m=+272.510134303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:49.253030 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.252998 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n"] Jul 02 14:52:49.255116 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.255101 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" Jul 02 14:52:49.257074 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.257052 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 14:52:49.257646 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.257629 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jr9vd\"" Jul 02 14:52:49.257730 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.257643 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 14:52:49.264630 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.264607 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n"] Jul 02 14:52:49.349410 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.349332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8pbq\" (UniqueName: \"kubernetes.io/projected/cc24d55f-b48c-4e22-a7f1-e804eab7da1a-kube-api-access-c8pbq\") pod \"migrator-786f9fbc5-gmf6n\" (UID: \"cc24d55f-b48c-4e22-a7f1-e804eab7da1a\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" Jul 02 14:52:49.450121 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.450031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8pbq\" (UniqueName: \"kubernetes.io/projected/cc24d55f-b48c-4e22-a7f1-e804eab7da1a-kube-api-access-c8pbq\") pod \"migrator-786f9fbc5-gmf6n\" (UID: \"cc24d55f-b48c-4e22-a7f1-e804eab7da1a\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" Jul 02 14:52:49.460033 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.460006 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8pbq\" (UniqueName: \"kubernetes.io/projected/cc24d55f-b48c-4e22-a7f1-e804eab7da1a-kube-api-access-c8pbq\") pod \"migrator-786f9fbc5-gmf6n\" (UID: \"cc24d55f-b48c-4e22-a7f1-e804eab7da1a\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" Jul 02 14:52:49.563987 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.563954 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" Jul 02 14:52:49.690648 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:52:49.690607 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc24d55f_b48c_4e22_a7f1_e804eab7da1a.slice/crio-80b4cb3234157503832e98aff90ce87ebd4a0c2603c5a3aebd0600ac4ba15f80 WatchSource:0}: Error finding container 80b4cb3234157503832e98aff90ce87ebd4a0c2603c5a3aebd0600ac4ba15f80: Status 404 returned error can't find the container with id 80b4cb3234157503832e98aff90ce87ebd4a0c2603c5a3aebd0600ac4ba15f80 Jul 02 14:52:49.692426 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.692313 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n"] Jul 02 14:52:49.965006 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:49.964976 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" event={"ID":"cc24d55f-b48c-4e22-a7f1-e804eab7da1a","Type":"ContainerStarted","Data":"80b4cb3234157503832e98aff90ce87ebd4a0c2603c5a3aebd0600ac4ba15f80"} Jul 02 14:52:50.155324 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:50.155288 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:50.155324 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:50.155334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:50.155778 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:50.155441 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.155778 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:50.155459 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:50.155778 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:50.155526 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.155510266 +0000 UTC m=+274.518327683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:50.155778 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:50.155544 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:52.15553678 +0000 UTC m=+274.518354194 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : configmap "kube-rbac-proxy" not found Jul 02 14:52:50.654773 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:50.654744 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pgr9x_31468509-9602-47e0-a0b6-c441b943d622/dns-node-resolver/0.log" Jul 02 14:52:51.280709 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.280674 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-fzs75"] Jul 02 14:52:51.282720 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.282703 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.284937 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.284914 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 14:52:51.285203 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.285174 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 14:52:51.285642 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.285626 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 14:52:51.285720 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.285704 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 14:52:51.285771 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.285706 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-sdfrg\"" Jul 02 14:52:51.294567 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.294546 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-fzs75"] Jul 02 14:52:51.367613 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.367580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.367782 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.367691 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dg2vg\" (UniqueName: \"kubernetes.io/projected/d667e2ab-4153-4fc5-9624-2f3428d8fab0-kube-api-access-dg2vg\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.367782 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.367735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-key\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.469042 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.469010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-key\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.469222 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.469083 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.469222 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.469152 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dg2vg\" (UniqueName: \"kubernetes.io/projected/d667e2ab-4153-4fc5-9624-2f3428d8fab0-kube-api-access-dg2vg\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.469794 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.469775 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-cabundle\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.471285 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.471266 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d667e2ab-4153-4fc5-9624-2f3428d8fab0-signing-key\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.477570 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.477550 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dg2vg\" (UniqueName: \"kubernetes.io/projected/d667e2ab-4153-4fc5-9624-2f3428d8fab0-kube-api-access-dg2vg\") pod \"service-ca-7bb4f4bcc7-fzs75\" (UID: \"d667e2ab-4153-4fc5-9624-2f3428d8fab0\") " pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.591592 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.591551 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" Jul 02 14:52:51.654832 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.654810 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh76s_83aacf8c-2ff4-414f-9877-418f528d0e7c/node-ca/0.log" Jul 02 14:52:51.709964 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.709939 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7bb4f4bcc7-fzs75"] Jul 02 14:52:51.713222 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:52:51.713199 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd667e2ab_4153_4fc5_9624_2f3428d8fab0.slice/crio-1a3994316eaf919f5f9500c86d3aab087c28a004423e155e26cce03768e8e119 WatchSource:0}: Error finding container 1a3994316eaf919f5f9500c86d3aab087c28a004423e155e26cce03768e8e119: Status 404 returned error can't find the container with id 1a3994316eaf919f5f9500c86d3aab087c28a004423e155e26cce03768e8e119 Jul 02 14:52:51.973016 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.972924 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" event={"ID":"cc24d55f-b48c-4e22-a7f1-e804eab7da1a","Type":"ContainerStarted","Data":"19c4d11c17d27703f121c8386c37c2bba7b248d9f39ed8ffdd24bfc1a304b1f7"} Jul 02 14:52:51.973016 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.972980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" event={"ID":"cc24d55f-b48c-4e22-a7f1-e804eab7da1a","Type":"ContainerStarted","Data":"ab6e9773ad851a716fe196bf49305b11192ddb6aed73fcbb3a790782065d7a03"} Jul 02 14:52:51.973966 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.973942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" event={"ID":"d667e2ab-4153-4fc5-9624-2f3428d8fab0","Type":"ContainerStarted","Data":"1a3994316eaf919f5f9500c86d3aab087c28a004423e155e26cce03768e8e119"} Jul 02 14:52:51.993604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:51.993562 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-gmf6n" podStartSLOduration=1.6296397219999998 podStartE2EDuration="2.993548656s" totalImagesPullingTime="1.363908934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:51.992856542 +0000 UTC m=+274.355674003" watchObservedRunningTime="2026-07-02 14:52:51.993548656 +0000 UTC m=+274.356366091" Jul 02 14:52:52.174825 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:52.174790 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:52.174987 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:52.174883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:52.174987 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:52.174915 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:52.174987 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:52.174970 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.174987 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:52.174979 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.174963575 +0000 UTC m=+278.537780989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : configmap "kube-rbac-proxy" not found Jul 02 14:52:52.175123 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:52.175006 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:52:56.174995597 +0000 UTC m=+278.537813011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:52.258017 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:52.257946 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mb7rb_46c466dd-a352-40cd-8551-15281b2cf831/serve-healthcheck-canary/0.log" Jul 02 14:52:53.982863 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:53.982782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" event={"ID":"d667e2ab-4153-4fc5-9624-2f3428d8fab0","Type":"ContainerStarted","Data":"787ce4f8bee5417c70e4d269b6873430a44c31ea2e2e74584baf8d619606731e"} Jul 02 14:52:53.998797 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:53.998696 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7bb4f4bcc7-fzs75" podStartSLOduration=1.081301109 podStartE2EDuration="2.998675248s" totalImagesPullingTime="1.917374139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:52:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:52:53.997942545 +0000 UTC m=+276.360759981" watchObservedRunningTime="2026-07-02 14:52:53.998675248 +0000 UTC m=+276.361492689" Jul 02 14:52:56.207571 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:56.207537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:56.207945 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:52:56.207580 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:52:56.207945 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:56.207666 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 14:52:56.207945 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:56.207695 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:52:56.207945 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:56.207733 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.207714393 +0000 UTC m=+286.570531811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : configmap "kube-rbac-proxy" not found Jul 02 14:52:56.207945 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:56.207749 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:53:04.207742316 +0000 UTC m=+286.570559730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:52:59.700123 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:59.700076 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-zf4zq" podUID="5a99a7d6-9f0e-42f2-80fe-b63255a41f78" Jul 02 14:52:59.700504 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:52:59.700122 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" Jul 02 14:53:00.001714 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:00.001641 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:00.001874 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:00.001644 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:03.463897 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.463860 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:03.464335 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.463952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:03.466181 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.466151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a99a7d6-9f0e-42f2-80fe-b63255a41f78-metrics-tls\") pod \"dns-default-zf4zq\" (UID: \"5a99a7d6-9f0e-42f2-80fe-b63255a41f78\") " pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:03.466422 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.466401 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"image-registry-755f8bbdd7-bw4t8\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:03.605158 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.605125 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gj2f4\"" Jul 02 14:53:03.605158 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.605125 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gj4nd\"" Jul 02 14:53:03.613795 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.613778 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:03.613893 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.613875 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:03.759068 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.759036 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zf4zq"] Jul 02 14:53:03.763024 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:03.762991 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a99a7d6_9f0e_42f2_80fe_b63255a41f78.slice/crio-93a094a09fe81d066b02606cf2593fb6ab0a227472967502e8a340be9203d9c7 WatchSource:0}: Error finding container 93a094a09fe81d066b02606cf2593fb6ab0a227472967502e8a340be9203d9c7: Status 404 returned error can't find the container with id 93a094a09fe81d066b02606cf2593fb6ab0a227472967502e8a340be9203d9c7 Jul 02 14:53:03.776265 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:03.776241 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:53:03.778669 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:03.778644 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fddff71_da0b_472e_b369_d3b3b4456dfa.slice/crio-de47d37d470a6f2719014ebe4818185f6760f0cfced674df5eec9eba35319ec7 WatchSource:0}: Error finding container de47d37d470a6f2719014ebe4818185f6760f0cfced674df5eec9eba35319ec7: Status 404 returned error can't find the container with id de47d37d470a6f2719014ebe4818185f6760f0cfced674df5eec9eba35319ec7 Jul 02 14:53:04.015681 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.015587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" event={"ID":"6fddff71-da0b-472e-b369-d3b3b4456dfa","Type":"ContainerStarted","Data":"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479"} Jul 02 14:53:04.015681 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.015643 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" event={"ID":"6fddff71-da0b-472e-b369-d3b3b4456dfa","Type":"ContainerStarted","Data":"de47d37d470a6f2719014ebe4818185f6760f0cfced674df5eec9eba35319ec7"} Jul 02 14:53:04.015901 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.015696 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:04.016853 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.016830 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf4zq" event={"ID":"5a99a7d6-9f0e-42f2-80fe-b63255a41f78","Type":"ContainerStarted","Data":"93a094a09fe81d066b02606cf2593fb6ab0a227472967502e8a340be9203d9c7"} Jul 02 14:53:04.032766 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.032729 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" podStartSLOduration=287.032715136 podStartE2EDuration="4m47.032715136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:04.03253278 +0000 UTC m=+286.395350216" watchObservedRunningTime="2026-07-02 14:53:04.032715136 +0000 UTC m=+286.395532571" Jul 02 14:53:04.271168 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.271081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:04.271168 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.271131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:04.271387 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:04.271255 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.271387 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:04.271329 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls podName:79dd1e91-02b6-437a-8402-34458a1095bf nodeName:}" failed. No retries permitted until 2026-07-02 14:53:20.271309385 +0000 UTC m=+302.634126807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wfj6f" (UID: "79dd1e91-02b6-437a-8402-34458a1095bf") : secret "insights-runtime-extractor-tls" not found Jul 02 14:53:04.271725 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:04.271699 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/79dd1e91-02b6-437a-8402-34458a1095bf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:06.026399 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:06.026359 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf4zq" event={"ID":"5a99a7d6-9f0e-42f2-80fe-b63255a41f78","Type":"ContainerStarted","Data":"9f620d875a0f8eeb816c56e01e3415b7628f8f671871ae4fbdf4e3fbe6be066d"} Jul 02 14:53:06.026866 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:06.026446 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zf4zq" event={"ID":"5a99a7d6-9f0e-42f2-80fe-b63255a41f78","Type":"ContainerStarted","Data":"d765116ce570167c4f419ff3cbc591b229c41b0dbc91595915b71c089d480e44"} Jul 02 14:53:06.026866 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:06.026520 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:06.041669 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:06.041624 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zf4zq" podStartSLOduration=251.489654881 podStartE2EDuration="4m13.041609282s" totalImagesPullingTime="1.551954401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:06.040287353 +0000 UTC m=+288.403104789" watchObservedRunningTime="2026-07-02 14:53:06.041609282 +0000 UTC m=+288.404426717" Jul 02 14:53:12.417809 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:12.417772 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:53:13.080989 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:13.080949 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pls7k" podUID="2ca7704b-8f91-4c64-8f35-0f295d28debd" Jul 02 14:53:16.032024 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:16.031991 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zf4zq" Jul 02 14:53:18.021560 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:18.021534 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:53:18.027475 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:18.027436 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 14:53:18.028853 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:18.028833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:53:19.863877 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.863848 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d"] Jul 02 14:53:19.865706 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.865692 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:19.867565 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.867545 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 14:53:19.867687 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.867643 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lqv5j\"" Jul 02 14:53:19.875320 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.875301 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d"] Jul 02 14:53:19.990865 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:19.990830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/edf34bb0-7228-438e-b262-e86bb4528a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-5978d\" (UID: \"edf34bb0-7228-438e-b262-e86bb4528a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:20.091507 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.091477 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/edf34bb0-7228-438e-b262-e86bb4528a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-5978d\" (UID: \"edf34bb0-7228-438e-b262-e86bb4528a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:20.093736 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.093711 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/edf34bb0-7228-438e-b262-e86bb4528a88-tls-certificates\") pod \"prometheus-operator-admission-webhook-7ddc8784d4-5978d\" (UID: \"edf34bb0-7228-438e-b262-e86bb4528a88\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:20.174227 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.174148 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:20.290522 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.290492 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d"] Jul 02 14:53:20.292886 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.292861 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:20.293043 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:20.292918 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf34bb0_7228_438e_b262_e86bb4528a88.slice/crio-7dec0793b4ba1d91599ad5978002c3cd07f96385497d1e50e088c1e8cd090f9b WatchSource:0}: Error finding container 7dec0793b4ba1d91599ad5978002c3cd07f96385497d1e50e088c1e8cd090f9b: Status 404 returned error can't find the container with id 7dec0793b4ba1d91599ad5978002c3cd07f96385497d1e50e088c1e8cd090f9b Jul 02 14:53:20.295042 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.295027 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:53:20.295322 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.295292 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/79dd1e91-02b6-437a-8402-34458a1095bf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wfj6f\" (UID: \"79dd1e91-02b6-437a-8402-34458a1095bf\") " pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:20.300619 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.300599 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f9m28\"" Jul 02 14:53:20.323533 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.323439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wfj6f" Jul 02 14:53:20.443504 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:20.443482 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wfj6f"] Jul 02 14:53:20.445781 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:20.445749 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79dd1e91_02b6_437a_8402_34458a1095bf.slice/crio-9380ba7285e85ee3e0d1577aad5c754206922787bcfe91e6b0c8369a7a76214c WatchSource:0}: Error finding container 9380ba7285e85ee3e0d1577aad5c754206922787bcfe91e6b0c8369a7a76214c: Status 404 returned error can't find the container with id 9380ba7285e85ee3e0d1577aad5c754206922787bcfe91e6b0c8369a7a76214c Jul 02 14:53:21.074476 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:21.074425 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfj6f" event={"ID":"79dd1e91-02b6-437a-8402-34458a1095bf","Type":"ContainerStarted","Data":"9380ba7285e85ee3e0d1577aad5c754206922787bcfe91e6b0c8369a7a76214c"} Jul 02 14:53:21.075685 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:21.075661 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" event={"ID":"edf34bb0-7228-438e-b262-e86bb4528a88","Type":"ContainerStarted","Data":"7dec0793b4ba1d91599ad5978002c3cd07f96385497d1e50e088c1e8cd090f9b"} Jul 02 14:53:22.085230 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:22.085184 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" event={"ID":"edf34bb0-7228-438e-b262-e86bb4528a88","Type":"ContainerStarted","Data":"9dfc64f47bd2672057cee78408555cb60039888984fec38b132b0fe652e61c01"} Jul 02 14:53:22.085704 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:22.085253 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:22.088041 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:22.088017 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" Jul 02 14:53:22.096364 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:22.096309 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7ddc8784d4-5978d" podStartSLOduration=1.828369857 podStartE2EDuration="3.096293789s" totalImagesPullingTime="1.267923932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:22.095502946 +0000 UTC m=+304.458320382" watchObservedRunningTime="2026-07-02 14:53:22.096293789 +0000 UTC m=+304.459111229" Jul 02 14:53:22.426032 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:22.425945 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:23.006549 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.006512 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-vlp75"] Jul 02 14:53:23.009093 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.009070 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.013012 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.012959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 02 14:53:23.016179 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.016158 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 02 14:53:23.016278 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.016246 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 14:53:23.016960 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.016426 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q9kf8\"" Jul 02 14:53:23.016960 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.016438 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 14:53:23.018629 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.018546 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 14:53:23.027108 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.027086 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-vlp75"] Jul 02 14:53:23.116661 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.116628 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjpwx\" (UniqueName: \"kubernetes.io/projected/6b1404da-532d-426d-9b75-55982d74088b-kube-api-access-hjpwx\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.116661 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.116662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.117176 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.116772 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b1404da-532d-426d-9b75-55982d74088b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.117176 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.116813 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.217735 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.217687 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b1404da-532d-426d-9b75-55982d74088b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.217916 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.217780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.217916 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.217851 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjpwx\" (UniqueName: \"kubernetes.io/projected/6b1404da-532d-426d-9b75-55982d74088b-kube-api-access-hjpwx\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.217916 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.217877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.218078 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:23.218020 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 02 14:53:23.218129 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:23.218085 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls podName:6b1404da-532d-426d-9b75-55982d74088b nodeName:}" failed. No retries permitted until 2026-07-02 14:53:23.718065535 +0000 UTC m=+306.080882950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls") pod "prometheus-operator-7b7d896497-vlp75" (UID: "6b1404da-532d-426d-9b75-55982d74088b") : secret "prometheus-operator-tls" not found Jul 02 14:53:23.218995 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.218966 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b1404da-532d-426d-9b75-55982d74088b-metrics-client-ca\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.221331 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.221288 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.227598 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.227556 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjpwx\" (UniqueName: \"kubernetes.io/projected/6b1404da-532d-426d-9b75-55982d74088b-kube-api-access-hjpwx\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.722221 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.722182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.725007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.724979 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b1404da-532d-426d-9b75-55982d74088b-prometheus-operator-tls\") pod \"prometheus-operator-7b7d896497-vlp75\" (UID: \"6b1404da-532d-426d-9b75-55982d74088b\") " pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:23.920438 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:23.920405 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" Jul 02 14:53:24.080748 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:24.080715 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:53:25.300582 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:25.300561 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7b7d896497-vlp75"] Jul 02 14:53:25.303309 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:25.303283 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1404da_532d_426d_9b75_55982d74088b.slice/crio-eb55afe307e28ba4e69c2f9b461f22cbee748b347b9d25e8f84611e488a7a8e2 WatchSource:0}: Error finding container eb55afe307e28ba4e69c2f9b461f22cbee748b347b9d25e8f84611e488a7a8e2: Status 404 returned error can't find the container with id eb55afe307e28ba4e69c2f9b461f22cbee748b347b9d25e8f84611e488a7a8e2 Jul 02 14:53:26.095375 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:26.095341 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" event={"ID":"6b1404da-532d-426d-9b75-55982d74088b","Type":"ContainerStarted","Data":"eb55afe307e28ba4e69c2f9b461f22cbee748b347b9d25e8f84611e488a7a8e2"} Jul 02 14:53:26.096804 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:26.096782 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfj6f" event={"ID":"79dd1e91-02b6-437a-8402-34458a1095bf","Type":"ContainerStarted","Data":"2a7b76e6fd29c41a59bc413305fe1a317e3bc827238bbe1b4fddfb5858cbbac8"} Jul 02 14:53:26.096896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:26.096824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfj6f" event={"ID":"79dd1e91-02b6-437a-8402-34458a1095bf","Type":"ContainerStarted","Data":"aa572eae3b2b74a2ed87402de12a1bf0f3ffb7ad69a7fc82d7c9bf35ad392cea"} Jul 02 14:53:29.109373 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:29.109344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wfj6f" event={"ID":"79dd1e91-02b6-437a-8402-34458a1095bf","Type":"ContainerStarted","Data":"4d847804ec1782a0a68fb753a84aa78c19360284732f37e303ed1e4ec07df5e2"} Jul 02 14:53:29.110994 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:29.110970 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" event={"ID":"6b1404da-532d-426d-9b75-55982d74088b","Type":"ContainerStarted","Data":"9283ac10d04de2d0f3f4c6dc988f4db79c1499de162a0e588f5a7f02860beba6"} Jul 02 14:53:29.111102 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:29.111016 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" event={"ID":"6b1404da-532d-426d-9b75-55982d74088b","Type":"ContainerStarted","Data":"3119e66b61f4b7c8b02c89926edcc31fb334593c66ff289a916240cc1c44b81f"} Jul 02 14:53:29.129433 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:29.129391 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wfj6f" podStartSLOduration=33.000505974 podStartE2EDuration="41.129377006s" totalImagesPullingTime="8.128871032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:52:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:29.128261882 +0000 UTC m=+311.491079319" watchObservedRunningTime="2026-07-02 14:53:29.129377006 +0000 UTC m=+311.492194441" Jul 02 14:53:31.475414 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.475345 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7b7d896497-vlp75" podStartSLOduration=6.078550791 podStartE2EDuration="9.475322314s" totalImagesPullingTime="3.396771523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:29.150534903 +0000 UTC m=+311.513352339" watchObservedRunningTime="2026-07-02 14:53:31.475322314 +0000 UTC m=+313.838139748" Jul 02 14:53:31.475854 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.475723 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k"] Jul 02 14:53:31.479451 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.479433 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.484391 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.484368 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 14:53:31.484548 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.484439 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 14:53:31.487976 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.487957 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2n8z4\"" Jul 02 14:53:31.494308 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.494283 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k"] Jul 02 14:53:31.513139 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.513116 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-dcnqw"] Jul 02 14:53:31.516302 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.516287 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.526270 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.526253 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 14:53:31.526383 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.526301 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vhmtf\"" Jul 02 14:53:31.526383 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.526352 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 14:53:31.526989 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.526970 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 14:53:31.537876 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.537843 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9ff5k"] Jul 02 14:53:31.540923 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.540910 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.543607 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.543589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 14:53:31.543718 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.543589 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 14:53:31.543986 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.543966 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9ks79\"" Jul 02 14:53:31.544067 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.543971 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 14:53:31.562157 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.562112 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-dcnqw"] Jul 02 14:53:31.588076 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.588050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.588168 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.588077 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb54v\" (UniqueName: \"kubernetes.io/projected/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-kube-api-access-bb54v\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.588168 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.588122 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.588269 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.588208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.689622 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689592 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrns\" (UniqueName: \"kubernetes.io/projected/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-api-access-brrns\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689636 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689659 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-root\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689704 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs9n4\" (UniqueName: \"kubernetes.io/projected/162b249b-69f7-405e-85c5-cf34def33a3d-kube-api-access-xs9n4\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689744 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-tls\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689768 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-textfile\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.689817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689812 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-metrics-client-ca\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689878 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.689988 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690018 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb54v\" (UniqueName: \"kubernetes.io/projected/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-kube-api-access-bb54v\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-wtmp\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:31.690083 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690088 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-sys\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.690200 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:31.690148 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls podName:df1288c8-cddd-4dd8-96d4-1d12bb9f632f nodeName:}" failed. No retries permitted until 2026-07-02 14:53:32.190129553 +0000 UTC m=+314.552946982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-nsr9k" (UID: "df1288c8-cddd-4dd8-96d4-1d12bb9f632f") : secret "openshift-state-metrics-tls" not found Jul 02 14:53:31.690703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690216 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.690703 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.690539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.692051 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.692030 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.705502 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.705481 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb54v\" (UniqueName: \"kubernetes.io/projected/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-kube-api-access-bb54v\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:31.791996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.791917 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.791996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.791994 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-wtmp\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-sys\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792078 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrns\" (UniqueName: \"kubernetes.io/projected/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-api-access-brrns\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792135 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-root\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792163 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-wtmp\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792206 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs9n4\" (UniqueName: \"kubernetes.io/projected/162b249b-69f7-405e-85c5-cf34def33a3d-kube-api-access-xs9n4\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-tls\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792261 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-textfile\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-metrics-client-ca\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792321 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792358 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:31.792515 2556 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:31.792585 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls podName:5d4a50e8-e90a-445f-8799-8efd8c4c02b0 nodeName:}" failed. No retries permitted until 2026-07-02 14:53:32.29256443 +0000 UTC m=+314.655381867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls") pod "kube-state-metrics-845b954455-dcnqw" (UID: "5d4a50e8-e90a-445f-8799-8efd8c4c02b0") : secret "kube-state-metrics-tls" not found Jul 02 14:53:31.792697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792687 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-root\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.793125 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792744 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.793125 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792801 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-metrics-client-ca\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.793125 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.792983 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.793289 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.793192 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-textfile\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.793289 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.793200 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/162b249b-69f7-405e-85c5-cf34def33a3d-sys\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.793397 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.793294 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-accelerators-collector-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.793771 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.793748 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/162b249b-69f7-405e-85c5-cf34def33a3d-metrics-client-ca\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.794843 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.794808 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.795540 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.795523 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/162b249b-69f7-405e-85c5-cf34def33a3d-node-exporter-tls\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.795922 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.795905 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.805043 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.805023 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs9n4\" (UniqueName: \"kubernetes.io/projected/162b249b-69f7-405e-85c5-cf34def33a3d-kube-api-access-xs9n4\") pod \"node-exporter-9ff5k\" (UID: \"162b249b-69f7-405e-85c5-cf34def33a3d\") " pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.805509 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.805492 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrns\" (UniqueName: \"kubernetes.io/projected/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-api-access-brrns\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:31.849510 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:31.849482 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9ff5k" Jul 02 14:53:31.860825 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:31.860799 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod162b249b_69f7_405e_85c5_cf34def33a3d.slice/crio-903a6850ee6db97df97c2a86148d8b044a8e99415ccd1133926d73a9916c4504 WatchSource:0}: Error finding container 903a6850ee6db97df97c2a86148d8b044a8e99415ccd1133926d73a9916c4504: Status 404 returned error can't find the container with id 903a6850ee6db97df97c2a86148d8b044a8e99415ccd1133926d73a9916c4504 Jul 02 14:53:32.122648 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.122613 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9ff5k" event={"ID":"162b249b-69f7-405e-85c5-cf34def33a3d","Type":"ContainerStarted","Data":"903a6850ee6db97df97c2a86148d8b044a8e99415ccd1133926d73a9916c4504"} Jul 02 14:53:32.196156 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.196117 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:32.196350 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:32.196229 2556 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 14:53:32.196350 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:32.196289 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls podName:df1288c8-cddd-4dd8-96d4-1d12bb9f632f nodeName:}" failed. No retries permitted until 2026-07-02 14:53:33.196273312 +0000 UTC m=+315.559090732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-nsr9k" (UID: "df1288c8-cddd-4dd8-96d4-1d12bb9f632f") : secret "openshift-state-metrics-tls" not found Jul 02 14:53:32.297395 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.297358 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:32.300007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.299964 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d4a50e8-e90a-445f-8799-8efd8c4c02b0-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-dcnqw\" (UID: \"5d4a50e8-e90a-445f-8799-8efd8c4c02b0\") " pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:32.425615 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.425528 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" Jul 02 14:53:32.572497 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:32.572444 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-dcnqw"] Jul 02 14:53:32.772321 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:32.772258 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4a50e8_e90a_445f_8799_8efd8c4c02b0.slice/crio-b32ee107deba890af4dc73d82f150c888d14ace269884dd9a3bf9709d3446659 WatchSource:0}: Error finding container b32ee107deba890af4dc73d82f150c888d14ace269884dd9a3bf9709d3446659: Status 404 returned error can't find the container with id b32ee107deba890af4dc73d82f150c888d14ace269884dd9a3bf9709d3446659 Jul 02 14:53:33.127948 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.127918 2556 generic.go:356] "Generic (PLEG): container finished" podID="162b249b-69f7-405e-85c5-cf34def33a3d" containerID="958d4dbd3d17336d3a9c63ef5ca6305183343826b9b401b9b47b141930f49598" exitCode=0 Jul 02 14:53:33.128106 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.127986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9ff5k" event={"ID":"162b249b-69f7-405e-85c5-cf34def33a3d","Type":"ContainerDied","Data":"958d4dbd3d17336d3a9c63ef5ca6305183343826b9b401b9b47b141930f49598"} Jul 02 14:53:33.129046 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.129026 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" event={"ID":"5d4a50e8-e90a-445f-8799-8efd8c4c02b0","Type":"ContainerStarted","Data":"b32ee107deba890af4dc73d82f150c888d14ace269884dd9a3bf9709d3446659"} Jul 02 14:53:33.205940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.205906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:33.208418 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.208399 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/df1288c8-cddd-4dd8-96d4-1d12bb9f632f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-nsr9k\" (UID: \"df1288c8-cddd-4dd8-96d4-1d12bb9f632f\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:33.289102 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.289072 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" Jul 02 14:53:33.411873 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:33.411852 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k"] Jul 02 14:53:33.413926 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:33.413894 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1288c8_cddd_4dd8_96d4_1d12bb9f632f.slice/crio-0634fbd366addf0077f8464d83d1a521e466d34cfa597c9cf0a8aec9d4935b5f WatchSource:0}: Error finding container 0634fbd366addf0077f8464d83d1a521e466d34cfa597c9cf0a8aec9d4935b5f: Status 404 returned error can't find the container with id 0634fbd366addf0077f8464d83d1a521e466d34cfa597c9cf0a8aec9d4935b5f Jul 02 14:53:34.133858 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.133823 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" event={"ID":"df1288c8-cddd-4dd8-96d4-1d12bb9f632f","Type":"ContainerStarted","Data":"5b44805579aeabfeb698b7416e3738d78edd707c28e8449a1973a04354c1ed59"} Jul 02 14:53:34.134228 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.133881 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" event={"ID":"df1288c8-cddd-4dd8-96d4-1d12bb9f632f","Type":"ContainerStarted","Data":"8f62b315e19eff35e80584fa707493990af4bb748691fa1e3ea359627aad5aa5"} Jul 02 14:53:34.134228 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.133911 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" event={"ID":"df1288c8-cddd-4dd8-96d4-1d12bb9f632f","Type":"ContainerStarted","Data":"0634fbd366addf0077f8464d83d1a521e466d34cfa597c9cf0a8aec9d4935b5f"} Jul 02 14:53:34.135748 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.135721 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9ff5k" event={"ID":"162b249b-69f7-405e-85c5-cf34def33a3d","Type":"ContainerStarted","Data":"1d40ed1f03133080d44cfe2b3e370d6d4a6708a8c0d75dbe4b6fcf476eef0cae"} Jul 02 14:53:34.135841 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.135767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9ff5k" event={"ID":"162b249b-69f7-405e-85c5-cf34def33a3d","Type":"ContainerStarted","Data":"6550d9f559dac17b118c580f3d78b9c8d9c5ca964453671fa0518168c2c9c17a"} Jul 02 14:53:34.159929 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:34.159892 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9ff5k" podStartSLOduration=2.14366226 podStartE2EDuration="3.159877893s" totalImagesPullingTime="951.662803ms" totalInitContainerRuntime="64.55283ms" isStatefulPod=true podCreationTimestamp="2026-07-02 14:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:34.158759435 +0000 UTC m=+316.521576870" watchObservedRunningTime="2026-07-02 14:53:34.159877893 +0000 UTC m=+316.522695307" Jul 02 14:53:35.141538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.141505 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" event={"ID":"df1288c8-cddd-4dd8-96d4-1d12bb9f632f","Type":"ContainerStarted","Data":"75f2cd7770d1f550a8218cf2277ac8b6d3bb5b58467c24714d50f5b43419d294"} Jul 02 14:53:35.143653 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.143623 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" event={"ID":"5d4a50e8-e90a-445f-8799-8efd8c4c02b0","Type":"ContainerStarted","Data":"0c339b85603c025d8d4a7dba47965a18d5030a17e928b7d3bdeb1bd6f96fafa2"} Jul 02 14:53:35.143770 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.143679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" event={"ID":"5d4a50e8-e90a-445f-8799-8efd8c4c02b0","Type":"ContainerStarted","Data":"9e44445c57297c177ddb7f83f5cce3b5d8632598096a74533cce6d52865742fa"} Jul 02 14:53:35.143770 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.143704 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" event={"ID":"5d4a50e8-e90a-445f-8799-8efd8c4c02b0","Type":"ContainerStarted","Data":"0cd4445e4fa92465a0acf8c82b46e9a9f5c1359a5980268090928e7d42d5e4d6"} Jul 02 14:53:35.159857 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.159813 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-nsr9k" podStartSLOduration=2.764638238 podStartE2EDuration="4.1597981s" totalImagesPullingTime="1.395159862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:35.158807118 +0000 UTC m=+317.521624574" watchObservedRunningTime="2026-07-02 14:53:35.1597981 +0000 UTC m=+317.522615535" Jul 02 14:53:35.176184 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:35.176139 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-dcnqw" podStartSLOduration=2.797193713 podStartE2EDuration="4.176121243s" totalImagesPullingTime="1.37892753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:35.175308819 +0000 UTC m=+317.538126255" watchObservedRunningTime="2026-07-02 14:53:35.176121243 +0000 UTC m=+317.538938681" Jul 02 14:53:36.088361 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.088320 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54cd549444-825pr"] Jul 02 14:53:36.092270 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.092249 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.095189 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.094958 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 14:53:36.095189 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.094981 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 14:53:36.095189 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.095154 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-t9wmt\"" Jul 02 14:53:36.095189 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.095189 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8fdrkptlqidah\"" Jul 02 14:53:36.095511 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.095198 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 14:53:36.095511 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.095156 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 14:53:36.101841 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.101769 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54cd549444-825pr"] Jul 02 14:53:36.126324 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-client-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126332 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-client-certs\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126351 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zf9\" (UniqueName: \"kubernetes.io/projected/23c749b8-3f7d-442e-a7c8-f0b1f0820167-kube-api-access-46zf9\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126371 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23c749b8-3f7d-442e-a7c8-f0b1f0820167-audit-log\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126426 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-metrics-server-audit-profiles\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.126505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.126489 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-tls\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.145059 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.145021 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt"] Jul 02 14:53:36.152985 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.152905 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.155048 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.155024 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9vxxz\"" Jul 02 14:53:36.155161 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.155052 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 14:53:36.157314 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.157290 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt"] Jul 02 14:53:36.227265 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-client-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.227544 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227524 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.227680 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-client-certs\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.227771 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zf9\" (UniqueName: \"kubernetes.io/projected/23c749b8-3f7d-442e-a7c8-f0b1f0820167-kube-api-access-46zf9\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.227872 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s96mc\" (UniqueName: \"kubernetes.io/projected/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-kube-api-access-s96mc\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.227961 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.227949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23c749b8-3f7d-442e-a7c8-f0b1f0820167-audit-log\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.228105 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.228093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.228194 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.228182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-metrics-server-audit-profiles\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.228350 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.228326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-tls\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.229197 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.228846 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/23c749b8-3f7d-442e-a7c8-f0b1f0820167-audit-log\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.229487 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.229435 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.229610 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.229590 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/23c749b8-3f7d-442e-a7c8-f0b1f0820167-metrics-server-audit-profiles\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.230761 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.230742 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-client-ca-bundle\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.230903 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.230885 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-tls\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.231169 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.231150 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/23c749b8-3f7d-442e-a7c8-f0b1f0820167-secret-metrics-server-client-certs\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.240644 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.240620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zf9\" (UniqueName: \"kubernetes.io/projected/23c749b8-3f7d-442e-a7c8-f0b1f0820167-kube-api-access-46zf9\") pod \"metrics-server-54cd549444-825pr\" (UID: \"23c749b8-3f7d-442e-a7c8-f0b1f0820167\") " pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.328992 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.328959 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.329237 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.329002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s96mc\" (UniqueName: \"kubernetes.io/projected/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-kube-api-access-s96mc\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.331562 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.331539 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.337042 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.337017 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s96mc\" (UniqueName: \"kubernetes.io/projected/7e5e49f3-c182-44ab-a1f8-9f1f18d57f10-kube-api-access-s96mc\") pod \"monitoring-plugin-cd8656b8-v5vlt\" (UID: \"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.403973 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.403883 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:36.462696 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.462664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:36.541911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.541883 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54cd549444-825pr"] Jul 02 14:53:36.545211 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:36.545183 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c749b8_3f7d_442e_a7c8_f0b1f0820167.slice/crio-89d1e01dcca6472cd8805a21df00fe4b0513c35c3a2ac22ea3981d0849a0f055 WatchSource:0}: Error finding container 89d1e01dcca6472cd8805a21df00fe4b0513c35c3a2ac22ea3981d0849a0f055: Status 404 returned error can't find the container with id 89d1e01dcca6472cd8805a21df00fe4b0513c35c3a2ac22ea3981d0849a0f055 Jul 02 14:53:36.597454 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:36.597419 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt"] Jul 02 14:53:36.599992 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:36.599968 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5e49f3_c182_44ab_a1f8_9f1f18d57f10.slice/crio-2c9b806467d48e3e28faf5793c5a7189e7a1e7f1a60b2a6fac4fef69bd5ca0d9 WatchSource:0}: Error finding container 2c9b806467d48e3e28faf5793c5a7189e7a1e7f1a60b2a6fac4fef69bd5ca0d9: Status 404 returned error can't find the container with id 2c9b806467d48e3e28faf5793c5a7189e7a1e7f1a60b2a6fac4fef69bd5ca0d9 Jul 02 14:53:37.156697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.156656 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54cd549444-825pr" event={"ID":"23c749b8-3f7d-442e-a7c8-f0b1f0820167","Type":"ContainerStarted","Data":"89d1e01dcca6472cd8805a21df00fe4b0513c35c3a2ac22ea3981d0849a0f055"} Jul 02 14:53:37.157918 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.157891 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" event={"ID":"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10","Type":"ContainerStarted","Data":"2c9b806467d48e3e28faf5793c5a7189e7a1e7f1a60b2a6fac4fef69bd5ca0d9"} Jul 02 14:53:37.438001 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.437742 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" containerName="registry" containerID="cri-o://da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479" gracePeriod=30 Jul 02 14:53:37.681266 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.679000 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:53:37.684975 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.683598 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.686674 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.686652 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 14:53:37.688312 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688260 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 14:53:37.688312 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688297 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 14:53:37.688448 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688330 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 14:53:37.688448 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688265 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 14:53:37.688958 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688938 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 14:53:37.689065 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.688975 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 14:53:37.689274 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689257 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66n72\"" Jul 02 14:53:37.689552 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689272 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 14:53:37.689552 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689412 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 14:53:37.689674 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 14:53:37.689674 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689635 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 14:53:37.689776 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.689690 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1h2l6id7t2q0\"" Jul 02 14:53:37.690046 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.690027 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 14:53:37.692779 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.692613 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 14:53:37.693985 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.693500 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 14:53:37.708419 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.708395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:53:37.727769 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.727692 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740716 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740768 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740800 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740843 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740879 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740900 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nb6m\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740944 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.740988 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets\") pod \"6fddff71-da0b-472e-b369-d3b3b4456dfa\" (UID: \"6fddff71-da0b-472e-b369-d3b3b4456dfa\") " Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741071 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741119 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741168 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741195 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741228 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741267 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.741604 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741303 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741346 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741435 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741493 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtrrt\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.741562 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742279 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742285 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.742586 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742553 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-certificates\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.745585 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.742624 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:53:37.746658 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.746511 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m" (OuterVolumeSpecName: "kube-api-access-2nb6m") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "kube-api-access-2nb6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:37.746658 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.746597 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:37.746658 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.746599 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:53:37.746863 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.746806 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:53:37.748881 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.748849 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:53:37.756311 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.756288 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6fddff71-da0b-472e-b369-d3b3b4456dfa" (UID: "6fddff71-da0b-472e-b369-d3b3b4456dfa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:53:37.843743 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843710 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.843743 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843772 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843900 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843918 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843969 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844004 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.843990 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844102 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtrrt\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844163 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844220 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6fddff71-da0b-472e-b369-d3b3b4456dfa-ca-trust-extracted\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844232 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-registry-tls\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844241 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nb6m\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-kube-api-access-2nb6m\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844254 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-installation-pull-secrets\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844267 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6fddff71-da0b-472e-b369-d3b3b4456dfa-image-registry-private-configuration\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844276 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6fddff71-da0b-472e-b369-d3b3b4456dfa-trusted-ca\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.844538 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844284 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6fddff71-da0b-472e-b369-d3b3b4456dfa-bound-sa-token\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:53:37.845325 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844868 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.845325 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.844985 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.845788 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.845429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.846128 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.846107 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.846718 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.846574 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.848352 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.847166 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.848352 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.848053 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.850281 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.850264 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.850737 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.850691 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.850985 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.850962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.851483 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.850884 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.853094 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.853073 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.853502 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.853479 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.853642 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.853620 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.853719 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.853708 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.854191 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.853962 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.854191 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.854151 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.854935 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.854916 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.855758 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.855736 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:37.863940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:37.863919 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtrrt\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt\") pod \"prometheus-k8s-0\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:38.020716 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.020623 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:38.165346 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.165308 2556 generic.go:356] "Generic (PLEG): container finished" podID="6fddff71-da0b-472e-b369-d3b3b4456dfa" containerID="da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479" exitCode=0 Jul 02 14:53:38.165817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.165356 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" Jul 02 14:53:38.165817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.165390 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" event={"ID":"6fddff71-da0b-472e-b369-d3b3b4456dfa","Type":"ContainerDied","Data":"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479"} Jul 02 14:53:38.165817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.165449 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f8bbdd7-bw4t8" event={"ID":"6fddff71-da0b-472e-b369-d3b3b4456dfa","Type":"ContainerDied","Data":"de47d37d470a6f2719014ebe4818185f6760f0cfced674df5eec9eba35319ec7"} Jul 02 14:53:38.165817 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.165511 2556 scope.go:117] "RemoveContainer" containerID="da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479" Jul 02 14:53:38.189970 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.189931 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:53:38.192644 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.192616 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-755f8bbdd7-bw4t8"] Jul 02 14:53:38.650757 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.650730 2556 scope.go:117] "RemoveContainer" containerID="da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479" Jul 02 14:53:38.651117 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:53:38.651092 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479\": container with ID starting with da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479 not found: ID does not exist" containerID="da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479" Jul 02 14:53:38.651201 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.651129 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479"} err="failed to get container status \"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479\": rpc error: code = NotFound desc = could not find container \"da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479\": container with ID starting with da60797a8c5ae8727097a5c45ba98659e16763b3449306ed086e4221f7cfb479 not found: ID does not exist" Jul 02 14:53:38.805173 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:38.805144 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:53:38.807471 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:53:38.807442 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8812cf_faf5_43b6_abdd_ac9f92c51f59.slice/crio-4d5b518c94b8f7a6eb4c83787d444c8ad802dc5c413dc414212ef2e19f0035db WatchSource:0}: Error finding container 4d5b518c94b8f7a6eb4c83787d444c8ad802dc5c413dc414212ef2e19f0035db: Status 404 returned error can't find the container with id 4d5b518c94b8f7a6eb4c83787d444c8ad802dc5c413dc414212ef2e19f0035db Jul 02 14:53:39.171755 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.171716 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" event={"ID":"7e5e49f3-c182-44ab-a1f8-9f1f18d57f10","Type":"ContainerStarted","Data":"a3680e810d84e7dda7c99d305888006c0be31e61b57ce7e0210857028ae2e580"} Jul 02 14:53:39.172209 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.171781 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:39.173028 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.172999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"4d5b518c94b8f7a6eb4c83787d444c8ad802dc5c413dc414212ef2e19f0035db"} Jul 02 14:53:39.175486 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.175444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54cd549444-825pr" event={"ID":"23c749b8-3f7d-442e-a7c8-f0b1f0820167","Type":"ContainerStarted","Data":"584e7f385daf5f47677abd655f83591e2103b622b1dc0cdbc48a5ca47f45020e"} Jul 02 14:53:39.177632 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.177608 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" Jul 02 14:53:39.189562 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.189514 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-v5vlt" podStartSLOduration=1.128196405 podStartE2EDuration="3.189496221s" totalImagesPullingTime="2.061299816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:39.18928527 +0000 UTC m=+321.552102706" watchObservedRunningTime="2026-07-02 14:53:39.189496221 +0000 UTC m=+321.552313658" Jul 02 14:53:39.225752 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:39.225696 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54cd549444-825pr" podStartSLOduration=1.11202399 podStartE2EDuration="3.225673883s" totalImagesPullingTime="2.113649893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:39.224739989 +0000 UTC m=+321.587557424" watchObservedRunningTime="2026-07-02 14:53:39.225673883 +0000 UTC m=+321.588491321" Jul 02 14:53:40.084818 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:40.084790 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" path="/var/lib/kubelet/pods/6fddff71-da0b-472e-b369-d3b3b4456dfa/volumes" Jul 02 14:53:40.180384 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:40.180351 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" exitCode=0 Jul 02 14:53:40.180831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:40.180441 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} Jul 02 14:53:44.198080 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:44.198046 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} Jul 02 14:53:44.198438 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:44.198123 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} Jul 02 14:53:46.207251 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:46.207224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} Jul 02 14:53:47.213312 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:47.213276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} Jul 02 14:53:47.213714 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:47.213339 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} Jul 02 14:53:47.213714 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:47.213366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerStarted","Data":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} Jul 02 14:53:47.242237 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:47.242183 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.21138763 podStartE2EDuration="10.242165517s" totalImagesPullingTime="7.013428812s" totalInitContainerRuntime="17.349075ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:53:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:53:47.240970139 +0000 UTC m=+329.603787585" watchObservedRunningTime="2026-07-02 14:53:47.242165517 +0000 UTC m=+329.604982954" Jul 02 14:53:48.021132 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:48.021099 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:53:56.404947 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:56.404913 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:53:56.405331 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:53:56.405003 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:54:08.291406 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:08.291373 2556 generic.go:356] "Generic (PLEG): container finished" podID="718fb371-8599-401e-abe1-54124f3244fa" containerID="db130474ef1623e3c7e7c14aa1c36ce0a5b23ff41130f8c9e1f5a5d0a7b230df" exitCode=0 Jul 02 14:54:08.291825 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:08.291443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-lf59p" event={"ID":"718fb371-8599-401e-abe1-54124f3244fa","Type":"ContainerDied","Data":"db130474ef1623e3c7e7c14aa1c36ce0a5b23ff41130f8c9e1f5a5d0a7b230df"} Jul 02 14:54:08.291825 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:08.291771 2556 scope.go:117] "RemoveContainer" containerID="db130474ef1623e3c7e7c14aa1c36ce0a5b23ff41130f8c9e1f5a5d0a7b230df" Jul 02 14:54:09.177012 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:09.176975 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mb7rb_46c466dd-a352-40cd-8551-15281b2cf831/serve-healthcheck-canary/0.log" Jul 02 14:54:09.296453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:09.296418 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-lf59p" event={"ID":"718fb371-8599-401e-abe1-54124f3244fa","Type":"ContainerStarted","Data":"ced41c3918eb16e929321068fe51faf401e01ba94a09dc760150bb19b694c029"} Jul 02 14:54:16.411062 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:16.410793 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:54:16.414771 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:16.414751 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54cd549444-825pr" Jul 02 14:54:31.923384 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:31.923345 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:54:31.925575 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:31.925553 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ca7704b-8f91-4c64-8f35-0f295d28debd-metrics-certs\") pod \"network-metrics-daemon-pls7k\" (UID: \"2ca7704b-8f91-4c64-8f35-0f295d28debd\") " pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:54:32.183965 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:32.183889 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wp67j\"" Jul 02 14:54:32.192377 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:32.192360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pls7k" Jul 02 14:54:32.318321 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:32.318290 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pls7k"] Jul 02 14:54:32.321600 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:54:32.321576 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ca7704b_8f91_4c64_8f35_0f295d28debd.slice/crio-78244e30853ace11c1f34b2db42e7cea5629c1b5525adb13dccd49fd688cd873 WatchSource:0}: Error finding container 78244e30853ace11c1f34b2db42e7cea5629c1b5525adb13dccd49fd688cd873: Status 404 returned error can't find the container with id 78244e30853ace11c1f34b2db42e7cea5629c1b5525adb13dccd49fd688cd873 Jul 02 14:54:32.397018 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:32.396986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pls7k" event={"ID":"2ca7704b-8f91-4c64-8f35-0f295d28debd","Type":"ContainerStarted","Data":"78244e30853ace11c1f34b2db42e7cea5629c1b5525adb13dccd49fd688cd873"} Jul 02 14:54:34.405611 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:34.405574 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pls7k" event={"ID":"2ca7704b-8f91-4c64-8f35-0f295d28debd","Type":"ContainerStarted","Data":"df0cea5068c898823cb9ee6fd0ad4b9c15f89a2f044459d3c7ce27f4fa85450f"} Jul 02 14:54:34.406069 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:34.405634 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pls7k" event={"ID":"2ca7704b-8f91-4c64-8f35-0f295d28debd","Type":"ContainerStarted","Data":"e03394ac1b74341dce56b386ed41920f14830fbeae4111ac1b2704ea308da17a"} Jul 02 14:54:34.422474 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:34.422429 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pls7k" podStartSLOduration=375.267258189 podStartE2EDuration="6m16.422415072s" totalImagesPullingTime="1.155156883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:48:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:34.421188309 +0000 UTC m=+376.784005745" watchObservedRunningTime="2026-07-02 14:54:34.422415072 +0000 UTC m=+376.785232507" Jul 02 14:54:38.021255 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:38.021219 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:38.040623 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:38.040595 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:38.435988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:38.435959 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.078697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.078663 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.079146 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079008 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="prometheus" containerID="cri-o://de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" gracePeriod=600 Jul 02 14:54:56.079146 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079039 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy" containerID="cri-o://0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" gracePeriod=600 Jul 02 14:54:56.079146 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079104 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" gracePeriod=600 Jul 02 14:54:56.079320 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079032 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="thanos-sidecar" containerID="cri-o://b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" gracePeriod=600 Jul 02 14:54:56.079320 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079079 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-web" containerID="cri-o://66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" gracePeriod=600 Jul 02 14:54:56.079320 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.079032 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="config-reloader" containerID="cri-o://244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" gracePeriod=600 Jul 02 14:54:56.322268 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.321922 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.429572 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429487 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429572 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429528 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429572 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429553 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429578 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429614 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429639 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429697 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429722 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429758 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429786 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429810 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429830 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.429862 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429848 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429876 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429911 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429938 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.429966 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430025 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430058 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430064 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430132 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430170 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtrrt\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt\") pod \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\" (UID: \"fa8812cf-faf5-43b6-abdd-ac9f92c51f59\") " Jul 02 14:54:56.430921 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430601 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.430921 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430621 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-metrics-client-ca\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.430921 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.430682 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:54:56.432273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.431170 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.432273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.431181 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.432273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.431391 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.432273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.431426 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.432273 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.431745 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 14:54:56.432695 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.432354 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.432695 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.432370 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.432695 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.432547 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.433403 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.433352 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.433845 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.433825 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:54:56.433952 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.433851 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt" (OuterVolumeSpecName: "kube-api-access-xtrrt") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "kube-api-access-xtrrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:54:56.434518 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.434482 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.434616 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.434596 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.434717 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.434697 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out" (OuterVolumeSpecName: "config-out") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:54:56.435408 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.435380 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config" (OuterVolumeSpecName: "config") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.435445 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.435426 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.444882 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.444864 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config" (OuterVolumeSpecName: "web-config") pod "fa8812cf-faf5-43b6-abdd-ac9f92c51f59" (UID: "fa8812cf-faf5-43b6-abdd-ac9f92c51f59"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 14:54:56.490207 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490180 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" exitCode=0 Jul 02 14:54:56.490207 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490202 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" exitCode=0 Jul 02 14:54:56.490207 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490208 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" exitCode=0 Jul 02 14:54:56.490207 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490213 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" exitCode=0 Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490218 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" exitCode=0 Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490224 2556 generic.go:356] "Generic (PLEG): container finished" podID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" exitCode=0 Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490260 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490259 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490344 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490390 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490407 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.490446 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} Jul 02 14:54:56.490780 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490500 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} Jul 02 14:54:56.490780 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} Jul 02 14:54:56.490780 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.490584 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa8812cf-faf5-43b6-abdd-ac9f92c51f59","Type":"ContainerDied","Data":"4d5b518c94b8f7a6eb4c83787d444c8ad802dc5c413dc414212ef2e19f0035db"} Jul 02 14:54:56.499036 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.499020 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.505940 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.505923 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.512821 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.512801 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.513493 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.513454 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.515726 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.515704 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.520759 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.520744 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.527336 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.527318 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.531560 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531542 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531561 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531574 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531583 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtrrt\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-kube-api-access-xtrrt\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531593 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-kube-rbac-proxy\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531602 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-grpc-tls\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531610 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531618 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-metrics-client-certs\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531626 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-k8s-db\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531636 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531634 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-tls-assets\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531643 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531652 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531659 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-config-out\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531667 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531675 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531683 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-web-config\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531690 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.531896 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.531698 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa8812cf-faf5-43b6-abdd-ac9f92c51f59-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 14:54:56.535841 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.535824 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.541831 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.541805 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.542075 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542063 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="config-reloader" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542077 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="config-reloader" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542085 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542091 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542097 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-thanos" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542103 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-thanos" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542110 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" containerName="registry" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542115 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" containerName="registry" Jul 02 14:54:56.542123 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542125 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="thanos-sidecar" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542130 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="thanos-sidecar" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542136 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-web" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542142 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-web" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542149 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="init-config-reloader" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542154 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="init-config-reloader" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542160 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="prometheus" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542164 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="prometheus" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542214 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="thanos-sidecar" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542222 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="prometheus" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542228 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-web" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542234 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542239 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="kube-rbac-proxy-thanos" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542244 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" containerName="config-reloader" Jul 02 14:54:56.542348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542251 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fddff71-da0b-472e-b369-d3b3b4456dfa" containerName="registry" Jul 02 14:54:56.542814 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.542800 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.543071 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.543056 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.543114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543079 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.543114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543095 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.543347 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.543325 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.543396 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543351 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.543396 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543364 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.543606 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.543591 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.543653 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543612 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.543653 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543625 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.543848 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.543824 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.543911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543858 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.543911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.543880 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.544197 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.544176 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.544279 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544205 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.544279 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544223 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.544616 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.544591 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.544727 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544620 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.544727 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544639 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.544933 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:54:56.544906 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.545012 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544936 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.545012 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.544955 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.545348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545329 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.545348 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545347 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.545618 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545598 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.545697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545620 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.545882 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545865 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.545937 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.545883 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.546080 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546064 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.546126 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546080 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.546307 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546287 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.546343 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546308 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.546535 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546520 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.546580 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546535 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.546716 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546703 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.546760 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546716 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.546903 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546886 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.546939 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.546904 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.547127 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547113 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.547170 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547127 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.547322 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547307 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.547364 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547323 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.547576 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547560 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.547628 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547576 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.547813 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547799 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.547866 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547810 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.547866 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.547826 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.548401 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548370 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.548401 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548403 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.548742 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548724 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.548742 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548742 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.548951 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548930 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.548951 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.548948 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.549184 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549166 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.549184 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549184 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.549383 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549363 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.549442 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549384 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.549639 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549623 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.549695 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549639 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.549841 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549826 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.549886 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.549841 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.550039 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550021 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.550092 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550041 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.550291 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550270 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.550291 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550289 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.550529 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550513 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.550577 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550530 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.550752 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550733 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.550796 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550753 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.550963 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550946 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.551016 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.550963 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.551196 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551178 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.551251 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551197 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.551397 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551382 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.551445 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551397 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.551690 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551663 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.551757 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551693 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.551911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551894 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.552008 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.551911 2556 scope.go:117] "RemoveContainer" containerID="0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36" Jul 02 14:54:56.552190 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552171 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36"} err="failed to get container status \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": rpc error: code = NotFound desc = could not find container \"0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36\": container with ID starting with 0f966255a26716f987c96ff1d56d82d11eb3f6ace7a34e67c1f1c5804b854c36 not found: ID does not exist" Jul 02 14:54:56.552190 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552188 2556 scope.go:117] "RemoveContainer" containerID="0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c" Jul 02 14:54:56.552404 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552381 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c"} err="failed to get container status \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": rpc error: code = NotFound desc = could not find container \"0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c\": container with ID starting with 0b69a479565b8948bc2b951bf5c70d8b8682199e49352d16d0e911d0ccfacd6c not found: ID does not exist" Jul 02 14:54:56.552404 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552404 2556 scope.go:117] "RemoveContainer" containerID="66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76" Jul 02 14:54:56.552630 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552613 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76"} err="failed to get container status \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": rpc error: code = NotFound desc = could not find container \"66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76\": container with ID starting with 66d27c9befa49239d6ea7f7aa9141fa68510516878b152ca8c5cdae53e53bc76 not found: ID does not exist" Jul 02 14:54:56.552630 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552630 2556 scope.go:117] "RemoveContainer" containerID="b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6" Jul 02 14:54:56.552900 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552882 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6"} err="failed to get container status \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": rpc error: code = NotFound desc = could not find container \"b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6\": container with ID starting with b81d3c4abb539042faa28174d00000f9566d53bed30a4e252e7b0a12b42b54d6 not found: ID does not exist" Jul 02 14:54:56.552900 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.552900 2556 scope.go:117] "RemoveContainer" containerID="244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b" Jul 02 14:54:56.553101 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.553084 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b"} err="failed to get container status \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": rpc error: code = NotFound desc = could not find container \"244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b\": container with ID starting with 244cef6ede4b890fccfb33549a7ac3631329ef2ba4d66a15f330c0f94e97203b not found: ID does not exist" Jul 02 14:54:56.553172 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.553101 2556 scope.go:117] "RemoveContainer" containerID="de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b" Jul 02 14:54:56.553359 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.553340 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b"} err="failed to get container status \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": rpc error: code = NotFound desc = could not find container \"de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b\": container with ID starting with de32095bdaa2b1897b10cf1256c76fd068dfdad9046e2be581e991aa34940f9b not found: ID does not exist" Jul 02 14:54:56.553359 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.553359 2556 scope.go:117] "RemoveContainer" containerID="4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c" Jul 02 14:54:56.553629 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.553607 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c"} err="failed to get container status \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": rpc error: code = NotFound desc = could not find container \"4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c\": container with ID starting with 4347b189f462019d026794d9104c1c22f7dd09c95c58487b86bf5a8a9c4e556c not found: ID does not exist" Jul 02 14:54:56.555876 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.555857 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 14:54:56.556089 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.556076 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 14:54:56.556279 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.556267 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 14:54:56.556355 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.556311 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 14:54:56.556581 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.556566 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 14:54:56.556633 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.556596 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 14:54:56.557359 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.557341 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 14:54:56.557426 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.557412 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 14:54:56.558748 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.558733 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1h2l6id7t2q0\"" Jul 02 14:54:56.558907 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.558893 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 14:54:56.558971 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.558919 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 14:54:56.559803 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.559788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66n72\"" Jul 02 14:54:56.559890 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.559875 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 14:54:56.562240 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.562223 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 14:54:56.569733 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.569708 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 14:54:56.591312 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.591286 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.593591 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.593571 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 14:54:56.632891 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632856 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.632891 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632924 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632951 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632973 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.632998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633029 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633051 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633114 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633073 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633118 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrszj\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-kube-api-access-zrszj\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633384 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633413 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633453 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.633827 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.633509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734084 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.733996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734084 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734035 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734084 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734084 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734085 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734106 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734157 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734246 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734272 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734325 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734400 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734396 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734458 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734516 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734550 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrszj\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-kube-api-access-zrszj\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734749 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.734936 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.734899 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.735274 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.735052 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.735274 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.735190 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737214 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737182 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737354 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737255 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737354 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737317 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737488 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737357 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737488 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4184ad63-54d1-4217-8a8a-100ccf5f82ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.737488 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.737429 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.738062 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.738034 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.738210 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.738187 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.738384 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.738252 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.738615 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.738598 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.738932 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.738914 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4184ad63-54d1-4217-8a8a-100ccf5f82ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.739664 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.739642 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.739856 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.739841 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.739956 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.739941 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.739993 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.739943 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4184ad63-54d1-4217-8a8a-100ccf5f82ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.744100 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.744083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrszj\" (UniqueName: \"kubernetes.io/projected/4184ad63-54d1-4217-8a8a-100ccf5f82ca-kube-api-access-zrszj\") pod \"prometheus-k8s-0\" (UID: \"4184ad63-54d1-4217-8a8a-100ccf5f82ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.858499 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.858444 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:54:56.994314 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:56.994234 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 14:54:56.996993 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:54:56.996971 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4184ad63_54d1_4217_8a8a_100ccf5f82ca.slice/crio-35a1073d957412186c07d0c79b29a713393efe2a793249515f0399dc6237546b WatchSource:0}: Error finding container 35a1073d957412186c07d0c79b29a713393efe2a793249515f0399dc6237546b: Status 404 returned error can't find the container with id 35a1073d957412186c07d0c79b29a713393efe2a793249515f0399dc6237546b Jul 02 14:54:57.495294 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:57.495264 2556 generic.go:356] "Generic (PLEG): container finished" podID="4184ad63-54d1-4217-8a8a-100ccf5f82ca" containerID="82a4defeffe81492775dee03e50074c85cce949f380ab2cba6c76eab4c8058d5" exitCode=0 Jul 02 14:54:57.495752 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:57.495361 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerDied","Data":"82a4defeffe81492775dee03e50074c85cce949f380ab2cba6c76eab4c8058d5"} Jul 02 14:54:57.495752 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:57.495441 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"35a1073d957412186c07d0c79b29a713393efe2a793249515f0399dc6237546b"} Jul 02 14:54:58.086243 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.086211 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8812cf-faf5-43b6-abdd-ac9f92c51f59" path="/var/lib/kubelet/pods/fa8812cf-faf5-43b6-abdd-ac9f92c51f59/volumes" Jul 02 14:54:58.503332 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503234 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"4f704035d41fc01798e56431800280771eb7e2c92fac06456a84eec1f3438b08"} Jul 02 14:54:58.503332 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503303 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"f5be1db0b3c9bb23f91d317310c704826baca1529b8cf34fa9ef6121def7dac3"} Jul 02 14:54:58.503332 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"781f930e7a1bffa940c08fbfa314c06317e147835dcd4d46cd125a62ccb7b3eb"} Jul 02 14:54:58.503842 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"dc690be8f9168cc6a3cdaa180017f8efd024523202b4f9b2a6d5e147ae1f8bdf"} Jul 02 14:54:58.503842 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503379 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"47677b64b6ba0b5a10b22c1e2993bc1f696b6f3b8ef7637c92bbc3682e82b5e3"} Jul 02 14:54:58.503842 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.503402 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4184ad63-54d1-4217-8a8a-100ccf5f82ca","Type":"ContainerStarted","Data":"0ac6335ace424da1fd4d654feb3490941eb204c55787314acb1a15b2b1aca7e4"} Jul 02 14:54:58.532376 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:54:58.532324 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5136665799999998 podStartE2EDuration="2.532305185s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.638605ms" isStatefulPod=false podCreationTimestamp="2026-07-02 14:54:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:54:58.529726709 +0000 UTC m=+400.892544145" watchObservedRunningTime="2026-07-02 14:54:58.532305185 +0000 UTC m=+400.895122623" Jul 02 14:55:01.859101 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:55:01.859064 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:55:56.859259 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:55:56.859225 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:55:56.874609 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:55:56.874584 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:55:57.740539 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:55:57.740515 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 14:57:53.891350 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.891314 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj"] Jul 02 14:57:53.893697 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.893680 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:53.895918 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.895890 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 14:57:53.896394 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.896379 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-knn67\"" Jul 02 14:57:53.896500 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.896393 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 14:57:53.902982 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.902963 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj"] Jul 02 14:57:53.996991 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.996950 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:53.997167 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:53.996997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svxqg\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-kube-api-access-svxqg\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.098379 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.098346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.098379 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.098380 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svxqg\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-kube-api-access-svxqg\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.112305 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.112276 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.112628 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.112613 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svxqg\" (UniqueName: \"kubernetes.io/projected/ce562292-d817-4ea0-84cd-841c478bd77c-kube-api-access-svxqg\") pod \"cert-manager-cainjector-559cdd8c87-hqgfj\" (UID: \"ce562292-d817-4ea0-84cd-841c478bd77c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.215427 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.215396 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" Jul 02 14:57:54.338650 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:54.338628 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj"] Jul 02 14:57:54.341440 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:57:54.341412 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce562292_d817_4ea0_84cd_841c478bd77c.slice/crio-ca6fbfb2707879af7571265df61fc707810c9928291c2daa67efea4c038a1b3f WatchSource:0}: Error finding container ca6fbfb2707879af7571265df61fc707810c9928291c2daa67efea4c038a1b3f: Status 404 returned error can't find the container with id ca6fbfb2707879af7571265df61fc707810c9928291c2daa67efea4c038a1b3f Jul 02 14:57:55.181686 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:55.178630 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" event={"ID":"ce562292-d817-4ea0-84cd-841c478bd77c","Type":"ContainerStarted","Data":"ca6fbfb2707879af7571265df61fc707810c9928291c2daa67efea4c038a1b3f"} Jul 02 14:57:58.195302 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:58.195260 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" event={"ID":"ce562292-d817-4ea0-84cd-841c478bd77c","Type":"ContainerStarted","Data":"1f1c6d04ec1ef0df5eacf5c328077ec13c32cd794c2957430e8c156885f9c452"} Jul 02 14:57:58.209894 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:57:58.209842 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hqgfj" podStartSLOduration=2.110135251 podStartE2EDuration="5.209826544s" totalImagesPullingTime="3.099691293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:57:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:57:58.209305706 +0000 UTC m=+580.572123142" watchObservedRunningTime="2026-07-02 14:57:58.209826544 +0000 UTC m=+580.572643981" Jul 02 14:58:04.931687 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.931651 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6"] Jul 02 14:58:04.933911 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.933896 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:04.935899 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.935875 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 14:58:04.936328 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.936312 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 14:58:04.936410 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.936343 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lzv7h\"" Jul 02 14:58:04.943522 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.943501 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6"] Jul 02 14:58:04.992320 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.992292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bdqw\" (UniqueName: \"kubernetes.io/projected/840d85e6-9464-4ae3-b341-3dc9478b3586-kube-api-access-2bdqw\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:04.992425 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:04.992325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840d85e6-9464-4ae3-b341-3dc9478b3586-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.093664 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.093632 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bdqw\" (UniqueName: \"kubernetes.io/projected/840d85e6-9464-4ae3-b341-3dc9478b3586-kube-api-access-2bdqw\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.093664 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.093665 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840d85e6-9464-4ae3-b341-3dc9478b3586-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.094007 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.093991 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/840d85e6-9464-4ae3-b341-3dc9478b3586-tmp\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.101326 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.101303 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bdqw\" (UniqueName: \"kubernetes.io/projected/840d85e6-9464-4ae3-b341-3dc9478b3586-kube-api-access-2bdqw\") pod \"openshift-lws-operator-fd8ccff4c-t5pd6\" (UID: \"840d85e6-9464-4ae3-b341-3dc9478b3586\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.242956 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.242881 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" Jul 02 14:58:05.369838 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:05.369814 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6"] Jul 02 14:58:05.372064 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:58:05.372041 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod840d85e6_9464_4ae3_b341_3dc9478b3586.slice/crio-2dbd7684e7898ccb868175a3480cae5620477d1cb559957f67181cfe961ee485 WatchSource:0}: Error finding container 2dbd7684e7898ccb868175a3480cae5620477d1cb559957f67181cfe961ee485: Status 404 returned error can't find the container with id 2dbd7684e7898ccb868175a3480cae5620477d1cb559957f67181cfe961ee485 Jul 02 14:58:06.227981 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:06.227932 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" event={"ID":"840d85e6-9464-4ae3-b341-3dc9478b3586","Type":"ContainerStarted","Data":"2dbd7684e7898ccb868175a3480cae5620477d1cb559957f67181cfe961ee485"} Jul 02 14:58:08.238365 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:08.238329 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" event={"ID":"840d85e6-9464-4ae3-b341-3dc9478b3586","Type":"ContainerStarted","Data":"224815cabdfe841faf751a0e86fd76de6772d524cabaed32b07d20c09710d841"} Jul 02 14:58:18.052319 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:18.052288 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:58:18.053026 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:18.053007 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 14:58:27.690113 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.690057 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-t5pd6" podStartSLOduration=21.238075311 podStartE2EDuration="23.690041099s" totalImagesPullingTime="2.451965788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:08.258636695 +0000 UTC m=+590.621454132" watchObservedRunningTime="2026-07-02 14:58:27.690041099 +0000 UTC m=+610.052858534" Jul 02 14:58:27.753246 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.690656 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc"] Jul 02 14:58:27.760227 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.760201 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc"] Jul 02 14:58:27.760347 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.760328 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.762736 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.762710 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pkwmq\"" Jul 02 14:58:27.763073 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.763045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 14:58:27.763266 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.763241 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 14:58:27.763571 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.763550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 14:58:27.763688 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.763550 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 14:58:27.890312 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.890279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.890515 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.890325 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.890515 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.890350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.890515 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.890380 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.890515 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.890471 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74p5\" (UniqueName: \"kubernetes.io/projected/ecbee67f-2c17-4a8c-bb66-19faf75018d0-kube-api-access-d74p5\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991135 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991135 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991086 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991135 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991135 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74p5\" (UniqueName: \"kubernetes.io/projected/ecbee67f-2c17-4a8c-bb66-19faf75018d0-kube-api-access-d74p5\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991553 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.991624 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.991606 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-manifests\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.993337 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.993310 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecbee67f-2c17-4a8c-bb66-19faf75018d0-tmp\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.993571 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.993552 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:27.993681 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:27.993663 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecbee67f-2c17-4a8c-bb66-19faf75018d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:28.002131 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:28.002110 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74p5\" (UniqueName: \"kubernetes.io/projected/ecbee67f-2c17-4a8c-bb66-19faf75018d0-kube-api-access-d74p5\") pod \"opendatahub-operator-controller-manager-758bbf8cc7-4rlxc\" (UID: \"ecbee67f-2c17-4a8c-bb66-19faf75018d0\") " pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:28.071214 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:28.071177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:28.221632 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:28.221611 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc"] Jul 02 14:58:28.223734 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:58:28.223709 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbee67f_2c17_4a8c_bb66_19faf75018d0.slice/crio-2fb4e1866b5ccb750f52ff9a61bc4db5cd0d98282b60a02c34c52806fd8314d8 WatchSource:0}: Error finding container 2fb4e1866b5ccb750f52ff9a61bc4db5cd0d98282b60a02c34c52806fd8314d8: Status 404 returned error can't find the container with id 2fb4e1866b5ccb750f52ff9a61bc4db5cd0d98282b60a02c34c52806fd8314d8 Jul 02 14:58:28.225486 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:28.225451 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:58:28.320783 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:28.320695 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" event={"ID":"ecbee67f-2c17-4a8c-bb66-19faf75018d0","Type":"ContainerStarted","Data":"2fb4e1866b5ccb750f52ff9a61bc4db5cd0d98282b60a02c34c52806fd8314d8"} Jul 02 14:58:31.336684 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:31.336653 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" event={"ID":"ecbee67f-2c17-4a8c-bb66-19faf75018d0","Type":"ContainerStarted","Data":"44b49e315f62578fd851d8b3314201853b442a20a3265fad50e163462feb58b4"} Jul 02 14:58:32.342534 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:32.342501 2556 generic.go:356] "Generic (PLEG): container finished" podID="ecbee67f-2c17-4a8c-bb66-19faf75018d0" containerID="44b49e315f62578fd851d8b3314201853b442a20a3265fad50e163462feb58b4" exitCode=0 Jul 02 14:58:32.342890 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:32.342575 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" event={"ID":"ecbee67f-2c17-4a8c-bb66-19faf75018d0","Type":"ContainerDied","Data":"44b49e315f62578fd851d8b3314201853b442a20a3265fad50e163462feb58b4"} Jul 02 14:58:33.349098 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:33.349060 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" event={"ID":"ecbee67f-2c17-4a8c-bb66-19faf75018d0","Type":"ContainerStarted","Data":"81fba8af62171192df4db1c0e95c02340fd12420dc5786cb32d540252d0da40a"} Jul 02 14:58:33.349578 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:33.349171 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:33.370516 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:33.370423 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" podStartSLOduration=2.060017754 podStartE2EDuration="6.370399256s" totalImagesPullingTime="3.278671506s" totalInitContainerRuntime="1.031709996s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:58:33.36979024 +0000 UTC m=+615.732607675" watchObservedRunningTime="2026-07-02 14:58:33.370399256 +0000 UTC m=+615.733216692" Jul 02 14:58:44.355539 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:44.355439 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-758bbf8cc7-4rlxc" Jul 02 14:58:57.800811 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.800783 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss"] Jul 02 14:58:57.808615 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.808586 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.813398 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.813376 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 14:58:57.813584 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.813568 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tsd52\"" Jul 02 14:58:57.815140 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.815114 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 14:58:57.815297 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.815281 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 14:58:57.828889 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.828854 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss"] Jul 02 14:58:57.844039 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.844015 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.844161 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.844062 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.844161 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.844135 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4aadd15a-45f4-4618-b53e-913a18e6a18e-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.844276 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.844177 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxqh\" (UniqueName: \"kubernetes.io/projected/4aadd15a-45f4-4618-b53e-913a18e6a18e-kube-api-access-4bxqh\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.944698 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.944669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.944860 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.944707 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.944860 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.944733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4aadd15a-45f4-4618-b53e-913a18e6a18e-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.944860 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.944765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxqh\" (UniqueName: \"kubernetes.io/projected/4aadd15a-45f4-4618-b53e-913a18e6a18e-kube-api-access-4bxqh\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.945452 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.945427 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4aadd15a-45f4-4618-b53e-913a18e6a18e-manager-config\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.947180 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.947154 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.947260 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.947233 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4aadd15a-45f4-4618-b53e-913a18e6a18e-metrics-cert\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:57.953633 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:57.953611 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxqh\" (UniqueName: \"kubernetes.io/projected/4aadd15a-45f4-4618-b53e-913a18e6a18e-kube-api-access-4bxqh\") pod \"lws-controller-manager-5bdfcfdbc4-f5kss\" (UID: \"4aadd15a-45f4-4618-b53e-913a18e6a18e\") " pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:58.119733 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:58.119697 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:58:58.317120 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:58.317003 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss"] Jul 02 14:58:58.319889 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:58:58.319857 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aadd15a_45f4_4618_b53e_913a18e6a18e.slice/crio-5f762c30704589770131a20514c850df2e271eca0a1f4457a6b454666df84363 WatchSource:0}: Error finding container 5f762c30704589770131a20514c850df2e271eca0a1f4457a6b454666df84363: Status 404 returned error can't find the container with id 5f762c30704589770131a20514c850df2e271eca0a1f4457a6b454666df84363 Jul 02 14:58:58.461234 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:58.461150 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" event={"ID":"4aadd15a-45f4-4618-b53e-913a18e6a18e","Type":"ContainerStarted","Data":"5f762c30704589770131a20514c850df2e271eca0a1f4457a6b454666df84363"} Jul 02 14:58:59.110286 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.110251 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dvql6"] Jul 02 14:58:59.113912 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.113890 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.118702 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.118681 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 14:58:59.119012 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.118991 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gkw9v\"" Jul 02 14:58:59.138981 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.138950 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dvql6"] Jul 02 14:58:59.144214 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.144190 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw"] Jul 02 14:58:59.147933 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.147908 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.154565 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.154542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.154678 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.154580 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ttlv\" (UniqueName: \"kubernetes.io/projected/cfb3e16d-09de-4c87-83d1-44971674a5e8-kube-api-access-5ttlv\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.154678 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.154607 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.154678 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.154642 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z7bf\" (UniqueName: \"kubernetes.io/projected/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-kube-api-access-9z7bf\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.156355 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.156333 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 14:58:59.157900 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.157679 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w6pkw\"" Jul 02 14:58:59.169893 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.169841 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw"] Jul 02 14:58:59.255733 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.255697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.255733 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.255732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ttlv\" (UniqueName: \"kubernetes.io/projected/cfb3e16d-09de-4c87-83d1-44971674a5e8-kube-api-access-5ttlv\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.255988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.255749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.255988 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:58:59.255853 2556 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 14:58:59.255988 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.255863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z7bf\" (UniqueName: \"kubernetes.io/projected/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-kube-api-access-9z7bf\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.255988 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:58:59.255917 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert podName:cfb3e16d-09de-4c87-83d1-44971674a5e8 nodeName:}" failed. No retries permitted until 2026-07-02 14:58:59.755898808 +0000 UTC m=+642.118716235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert") pod "kserve-controller-manager-d6f4b65b8-dvql6" (UID: "cfb3e16d-09de-4c87-83d1-44971674a5e8") : secret "kserve-webhook-server-cert" not found Jul 02 14:58:59.255988 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:58:59.255941 2556 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 02 14:58:59.256227 ip-10-0-131-199 kubenswrapper[2556]: E0702 14:58:59.255998 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert podName:c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db nodeName:}" failed. No retries permitted until 2026-07-02 14:58:59.755980689 +0000 UTC m=+642.118798107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert") pod "llmisvc-controller-manager-777c6bd7d5-2rhfw" (UID: "c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db") : secret "llmisvc-webhook-server-cert" not found Jul 02 14:58:59.265968 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.265938 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z7bf\" (UniqueName: \"kubernetes.io/projected/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-kube-api-access-9z7bf\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.266088 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.266056 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ttlv\" (UniqueName: \"kubernetes.io/projected/cfb3e16d-09de-4c87-83d1-44971674a5e8-kube-api-access-5ttlv\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.759690 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.759658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.759880 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.759698 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:58:59.762030 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.762005 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfb3e16d-09de-4c87-83d1-44971674a5e8-cert\") pod \"kserve-controller-manager-d6f4b65b8-dvql6\" (UID: \"cfb3e16d-09de-4c87-83d1-44971674a5e8\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:58:59.762163 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:58:59.762070 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-2rhfw\" (UID: \"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:59:00.027762 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.027682 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:59:00.060903 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.060858 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:59:00.180363 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.180045 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dvql6"] Jul 02 14:59:00.182789 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:59:00.182743 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb3e16d_09de_4c87_83d1_44971674a5e8.slice/crio-9c12c2191a08eb986922e5ef27e0b04e5509bb6139453c88b8b8fcbeafe37053 WatchSource:0}: Error finding container 9c12c2191a08eb986922e5ef27e0b04e5509bb6139453c88b8b8fcbeafe37053: Status 404 returned error can't find the container with id 9c12c2191a08eb986922e5ef27e0b04e5509bb6139453c88b8b8fcbeafe37053 Jul 02 14:59:00.218878 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.218849 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw"] Jul 02 14:59:00.220338 ip-10-0-131-199 kubenswrapper[2556]: W0702 14:59:00.220315 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc34f3ecc_eec1_4e3e_a266_7ccb4fffe9db.slice/crio-6b1dc1e358e8542355c46fca9ee52e734265d77cc445adfad302d6d3549ce091 WatchSource:0}: Error finding container 6b1dc1e358e8542355c46fca9ee52e734265d77cc445adfad302d6d3549ce091: Status 404 returned error can't find the container with id 6b1dc1e358e8542355c46fca9ee52e734265d77cc445adfad302d6d3549ce091 Jul 02 14:59:00.473659 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.473622 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" event={"ID":"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db","Type":"ContainerStarted","Data":"6b1dc1e358e8542355c46fca9ee52e734265d77cc445adfad302d6d3549ce091"} Jul 02 14:59:00.474907 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:00.474874 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" event={"ID":"cfb3e16d-09de-4c87-83d1-44971674a5e8","Type":"ContainerStarted","Data":"9c12c2191a08eb986922e5ef27e0b04e5509bb6139453c88b8b8fcbeafe37053"} Jul 02 14:59:01.480505 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:01.480457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" event={"ID":"4aadd15a-45f4-4618-b53e-913a18e6a18e","Type":"ContainerStarted","Data":"4a45cf9850a11f6695d621eb9dbb10c7462c2aa6a81ff5ffeee516d2c1a694e9"} Jul 02 14:59:01.480851 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:01.480600 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:59:01.500691 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:01.500430 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" podStartSLOduration=1.8493042750000002 podStartE2EDuration="4.500410836s" totalImagesPullingTime="2.651106561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:01.499914756 +0000 UTC m=+643.862732207" watchObservedRunningTime="2026-07-02 14:59:01.500410836 +0000 UTC m=+643.863228274" Jul 02 14:59:04.502331 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.502233 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" event={"ID":"c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db","Type":"ContainerStarted","Data":"3842f86f35b55dae74511d6b899875f6d5587bdc7697807f41c08f224f40e3a6"} Jul 02 14:59:04.502331 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.502304 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:59:04.503746 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.503721 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" event={"ID":"cfb3e16d-09de-4c87-83d1-44971674a5e8","Type":"ContainerStarted","Data":"1083f23b8fa8f7f815553896401913d16987204f21a7dae273a7e40cba80bf02"} Jul 02 14:59:04.503823 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.503777 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:59:04.519808 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.519764 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" podStartSLOduration=1.62143384 podStartE2EDuration="5.519751292s" totalImagesPullingTime="3.898317452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:04.517733194 +0000 UTC m=+646.880550663" watchObservedRunningTime="2026-07-02 14:59:04.519751292 +0000 UTC m=+646.882568705" Jul 02 14:59:04.548181 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:04.548135 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" podStartSLOduration=1.6172483469999999 podStartE2EDuration="5.54811937s" totalImagesPullingTime="3.930871023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:04.539734155 +0000 UTC m=+646.902551603" watchObservedRunningTime="2026-07-02 14:59:04.54811937 +0000 UTC m=+646.910936805" Jul 02 14:59:12.494122 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:12.494092 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5bdfcfdbc4-f5kss" Jul 02 14:59:35.511060 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:35.511029 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-2rhfw" Jul 02 14:59:35.514202 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:35.514181 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dvql6" Jul 02 14:59:48.153694 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.153662 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pq669"] Jul 02 14:59:48.155996 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.155978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:48.158335 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.158311 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 14:59:48.158481 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.158393 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 14:59:48.160681 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.160650 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xhxgb\"" Jul 02 14:59:48.179531 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.179505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnjk5\" (UniqueName: \"kubernetes.io/projected/3473bf4c-6d29-42dc-b6c8-488034c56a66-kube-api-access-hnjk5\") pod \"kuadrant-operator-catalog-pq669\" (UID: \"3473bf4c-6d29-42dc-b6c8-488034c56a66\") " pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:48.184266 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.184244 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pq669"] Jul 02 14:59:48.280704 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.280669 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnjk5\" (UniqueName: \"kubernetes.io/projected/3473bf4c-6d29-42dc-b6c8-488034c56a66-kube-api-access-hnjk5\") pod \"kuadrant-operator-catalog-pq669\" (UID: \"3473bf4c-6d29-42dc-b6c8-488034c56a66\") " pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:48.295749 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.295723 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnjk5\" (UniqueName: \"kubernetes.io/projected/3473bf4c-6d29-42dc-b6c8-488034c56a66-kube-api-access-hnjk5\") pod \"kuadrant-operator-catalog-pq669\" (UID: \"3473bf4c-6d29-42dc-b6c8-488034c56a66\") " pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:48.466164 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.466084 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:48.594659 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.594633 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pq669"] Jul 02 14:59:48.700647 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:48.700608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pq669" event={"ID":"3473bf4c-6d29-42dc-b6c8-488034c56a66","Type":"ContainerStarted","Data":"3dad01f09b63cf86525f7c91bc593a606beed5bb9ca1308980657d16eb1471e7"} Jul 02 14:59:51.714673 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:51.714637 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pq669" event={"ID":"3473bf4c-6d29-42dc-b6c8-488034c56a66","Type":"ContainerStarted","Data":"f13716c71f25615d5fee446c5e0e7688f8f9273f50c38f17ced9db76b9b8c39f"} Jul 02 14:59:51.731087 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:51.731039 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pq669" podStartSLOduration=1.613854147 podStartE2EDuration="3.731026624s" totalImagesPullingTime="2.117172477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:59:51.730494159 +0000 UTC m=+694.093311595" watchObservedRunningTime="2026-07-02 14:59:51.731026624 +0000 UTC m=+694.093844060" Jul 02 14:59:58.466383 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:58.466348 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:58.466887 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:58.466421 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:58.488711 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:58.488685 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 14:59:58.769444 ip-10-0-131-199 kubenswrapper[2556]: I0702 14:59:58.769371 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pq669" Jul 02 15:00:26.379256 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.379223 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x"] Jul 02 15:00:26.383761 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.383734 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.385730 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.385713 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rrphb\"" Jul 02 15:00:26.396304 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.396283 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x"] Jul 02 15:00:26.485723 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.485683 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rfcf\" (UniqueName: \"kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.485723 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.485728 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.586320 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.586291 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rfcf\" (UniqueName: \"kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.586535 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.586326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.586689 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.586672 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.600186 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.600156 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rfcf\" (UniqueName: \"kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.693728 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.693640 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:26.833661 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.833633 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x"] Jul 02 15:00:26.836362 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:00:26.836330 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba337fd_dc3d_4995_bb91_7666484ae8ec.slice/crio-ca62143a7355f3fc5d7c964c678138d2f90efd642b8db26d3db8429e9279ceec WatchSource:0}: Error finding container ca62143a7355f3fc5d7c964c678138d2f90efd642b8db26d3db8429e9279ceec: Status 404 returned error can't find the container with id ca62143a7355f3fc5d7c964c678138d2f90efd642b8db26d3db8429e9279ceec Jul 02 15:00:26.874713 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:26.874678 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" event={"ID":"8ba337fd-dc3d-4995-bb91-7666484ae8ec","Type":"ContainerStarted","Data":"ca62143a7355f3fc5d7c964c678138d2f90efd642b8db26d3db8429e9279ceec"} Jul 02 15:00:31.024349 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.024315 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k"] Jul 02 15:00:31.026906 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.026891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:31.029325 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.029303 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-kxqqq\"" Jul 02 15:00:31.029456 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.029443 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 15:00:31.046804 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.046780 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k"] Jul 02 15:00:31.137304 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.137270 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqwh\" (UniqueName: \"kubernetes.io/projected/dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc-kube-api-access-8qqwh\") pod \"dns-operator-controller-manager-864dd78c4c-8vt9k\" (UID: \"dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:31.238614 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.238577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqwh\" (UniqueName: \"kubernetes.io/projected/dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc-kube-api-access-8qqwh\") pod \"dns-operator-controller-manager-864dd78c4c-8vt9k\" (UID: \"dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:31.254631 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.254602 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqwh\" (UniqueName: \"kubernetes.io/projected/dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc-kube-api-access-8qqwh\") pod \"dns-operator-controller-manager-864dd78c4c-8vt9k\" (UID: \"dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:31.337835 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.337802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:31.516402 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:00:31.516364 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcab8de0_57d6_42f4_a4aa_2419dbc7d6fc.slice/crio-a94490bca141c05a9511d452ac8351d63002c984940a98aef7d8e86b200c43be WatchSource:0}: Error finding container a94490bca141c05a9511d452ac8351d63002c984940a98aef7d8e86b200c43be: Status 404 returned error can't find the container with id a94490bca141c05a9511d452ac8351d63002c984940a98aef7d8e86b200c43be Jul 02 15:00:31.521346 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.521322 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k"] Jul 02 15:00:31.900324 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:31.900291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" event={"ID":"dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc","Type":"ContainerStarted","Data":"a94490bca141c05a9511d452ac8351d63002c984940a98aef7d8e86b200c43be"} Jul 02 15:00:33.709835 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.709803 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2"] Jul 02 15:00:33.712769 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.712748 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:33.715018 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.714996 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-zwc6p\"" Jul 02 15:00:33.728973 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.728947 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2"] Jul 02 15:00:33.863938 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.863907 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn94k\" (UniqueName: \"kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k\") pod \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" (UID: \"73013ae6-9335-4656-8b7c-3e33387cc950\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:33.965439 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.965352 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn94k\" (UniqueName: \"kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k\") pod \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" (UID: \"73013ae6-9335-4656-8b7c-3e33387cc950\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:33.973533 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:33.973503 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn94k\" (UniqueName: \"kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k\") pod \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" (UID: \"73013ae6-9335-4656-8b7c-3e33387cc950\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:34.025371 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.025327 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:34.639560 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.639523 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2"] Jul 02 15:00:34.642544 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:00:34.642515 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73013ae6_9335_4656_8b7c_3e33387cc950.slice/crio-76188d6c2e7f7dcd6b905e395bbdef7d427423e24af412ed9286bfb0f6a2a2ce WatchSource:0}: Error finding container 76188d6c2e7f7dcd6b905e395bbdef7d427423e24af412ed9286bfb0f6a2a2ce: Status 404 returned error can't find the container with id 76188d6c2e7f7dcd6b905e395bbdef7d427423e24af412ed9286bfb0f6a2a2ce Jul 02 15:00:34.918774 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.918735 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" event={"ID":"73013ae6-9335-4656-8b7c-3e33387cc950","Type":"ContainerStarted","Data":"76188d6c2e7f7dcd6b905e395bbdef7d427423e24af412ed9286bfb0f6a2a2ce"} Jul 02 15:00:34.920310 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.920281 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" event={"ID":"8ba337fd-dc3d-4995-bb91-7666484ae8ec","Type":"ContainerStarted","Data":"795aaf49b6def1370b870e6e48306edb1172e97bd888e73e1cf3bad43514d22b"} Jul 02 15:00:34.920508 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.920410 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:34.921739 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.921717 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" event={"ID":"dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc","Type":"ContainerStarted","Data":"8e66192a968470aa2c3e47b2bc77e98643005263ff3f62af24da97c066d9d59a"} Jul 02 15:00:34.921859 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.921848 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:34.944704 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.944653 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" podStartSLOduration=1.670890744 podStartE2EDuration="8.94463504s" totalImagesPullingTime="7.273744296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:34.943385095 +0000 UTC m=+737.306202556" watchObservedRunningTime="2026-07-02 15:00:34.94463504 +0000 UTC m=+737.307452475" Jul 02 15:00:34.965621 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:34.965563 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" podStartSLOduration=1.9552904290000002 podStartE2EDuration="4.96554693s" totalImagesPullingTime="3.010256501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:34.96398386 +0000 UTC m=+737.326801345" watchObservedRunningTime="2026-07-02 15:00:34.96554693 +0000 UTC m=+737.328364367" Jul 02 15:00:37.940172 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:37.940138 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" event={"ID":"73013ae6-9335-4656-8b7c-3e33387cc950","Type":"ContainerStarted","Data":"11b1de5396f2525981e74fdcc7a280a1b21065cd0ad2fa50a2891b0f335700e1"} Jul 02 15:00:37.940632 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:37.940228 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:37.958558 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:37.958513 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" podStartSLOduration=2.565586958 podStartE2EDuration="4.958498294s" totalImagesPullingTime="2.392911336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:37.957662667 +0000 UTC m=+740.320480103" watchObservedRunningTime="2026-07-02 15:00:37.958498294 +0000 UTC m=+740.321315758" Jul 02 15:00:45.929697 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:45.929667 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-8vt9k" Jul 02 15:00:45.930138 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:45.929741 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.831061 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.831026 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x"] Jul 02 15:00:47.831593 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.831200 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" containerName="manager" containerID="cri-o://795aaf49b6def1370b870e6e48306edb1172e97bd888e73e1cf3bad43514d22b" gracePeriod=2 Jul 02 15:00:47.844550 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.844514 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x"] Jul 02 15:00:47.853065 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.853017 2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8ba337fd-dc3d-4995-bb91-7666484ae8ec\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.855429 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.855405 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2"] Jul 02 15:00:47.855620 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.855597 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" containerName="manager" containerID="cri-o://11b1de5396f2525981e74fdcc7a280a1b21065cd0ad2fa50a2891b0f335700e1" gracePeriod=2 Jul 02 15:00:47.857328 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.857296 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.857795 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.857739 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:47.861915 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.861869 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2"] Jul 02 15:00:47.863684 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.863654 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.866074 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.866047 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:47.871189 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871125 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:00:47.871697 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871679 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" containerName="manager" Jul 02 15:00:47.871769 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871702 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" containerName="manager" Jul 02 15:00:47.871769 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871740 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" containerName="manager" Jul 02 15:00:47.871769 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871749 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" containerName="manager" Jul 02 15:00:47.871862 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871836 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" containerName="manager" Jul 02 15:00:47.871862 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.871854 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" containerName="manager" Jul 02 15:00:47.880079 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.880056 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.885047 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.885011 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8cbq\" (UniqueName: \"kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.885213 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.885186 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.887252 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.887232 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:00:47.892776 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.892754 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf"] Jul 02 15:00:47.897180 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.897162 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:47.908663 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.908628 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.909590 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.909569 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf"] Jul 02 15:00:47.910078 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.910055 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:47.939266 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.939232 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:47.942064 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:47.942024 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:47.985939 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.985910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8cbq\" (UniqueName: \"kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.986108 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.985961 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.986108 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.986005 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p97gq\" (UniqueName: \"kubernetes.io/projected/b5478fb5-2deb-4608-9181-4a9f831dd1c5-kube-api-access-p97gq\") pod \"limitador-operator-controller-manager-859d7b78bd-fqprf\" (UID: \"b5478fb5-2deb-4608-9181-4a9f831dd1c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:47.986513 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.986485 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:47.987915 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.987893 2556 generic.go:356] "Generic (PLEG): container finished" podID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" containerID="795aaf49b6def1370b870e6e48306edb1172e97bd888e73e1cf3bad43514d22b" exitCode=0 Jul 02 15:00:47.989961 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:47.989936 2556 generic.go:356] "Generic (PLEG): container finished" podID="73013ae6-9335-4656-8b7c-3e33387cc950" containerID="11b1de5396f2525981e74fdcc7a280a1b21065cd0ad2fa50a2891b0f335700e1" exitCode=0 Jul 02 15:00:48.000424 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.000370 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8cbq\" (UniqueName: \"kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-p7bkg\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:48.085674 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:48.085649 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xcp4x\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:48.086951 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.086931 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p97gq\" (UniqueName: \"kubernetes.io/projected/b5478fb5-2deb-4608-9181-4a9f831dd1c5-kube-api-access-p97gq\") pod \"limitador-operator-controller-manager-859d7b78bd-fqprf\" (UID: \"b5478fb5-2deb-4608-9181-4a9f831dd1c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:48.087594 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:48.087567 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:48.099196 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.099177 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:48.099879 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.099853 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p97gq\" (UniqueName: \"kubernetes.io/projected/b5478fb5-2deb-4608-9181-4a9f831dd1c5-kube-api-access-p97gq\") pod \"limitador-operator-controller-manager-859d7b78bd-fqprf\" (UID: \"b5478fb5-2deb-4608-9181-4a9f831dd1c5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:48.101840 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.101825 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:48.188021 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.187994 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rfcf\" (UniqueName: \"kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf\") pod \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " Jul 02 15:00:48.188196 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.188039 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume\") pod \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\" (UID: \"8ba337fd-dc3d-4995-bb91-7666484ae8ec\") " Jul 02 15:00:48.188196 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.188135 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn94k\" (UniqueName: \"kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k\") pod \"73013ae6-9335-4656-8b7c-3e33387cc950\" (UID: \"73013ae6-9335-4656-8b7c-3e33387cc950\") " Jul 02 15:00:48.188596 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.188571 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ba337fd-dc3d-4995-bb91-7666484ae8ec" (UID: "8ba337fd-dc3d-4995-bb91-7666484ae8ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:00:48.190201 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.190178 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k" (OuterVolumeSpecName: "kube-api-access-rn94k") pod "73013ae6-9335-4656-8b7c-3e33387cc950" (UID: "73013ae6-9335-4656-8b7c-3e33387cc950"). InnerVolumeSpecName "kube-api-access-rn94k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:48.190272 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.190211 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf" (OuterVolumeSpecName: "kube-api-access-2rfcf") pod "8ba337fd-dc3d-4995-bb91-7666484ae8ec" (UID: "8ba337fd-dc3d-4995-bb91-7666484ae8ec"). InnerVolumeSpecName "kube-api-access-2rfcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:00:48.254444 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.254418 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:48.262857 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.260338 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:48.289072 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.289030 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rfcf\" (UniqueName: \"kubernetes.io/projected/8ba337fd-dc3d-4995-bb91-7666484ae8ec-kube-api-access-2rfcf\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:00:48.289072 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.289069 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ba337fd-dc3d-4995-bb91-7666484ae8ec-extensions-socket-volume\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:00:48.289236 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.289081 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn94k\" (UniqueName: \"kubernetes.io/projected/73013ae6-9335-4656-8b7c-3e33387cc950-kube-api-access-rn94k\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:00:48.393818 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.393797 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf"] Jul 02 15:00:48.396550 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:00:48.396524 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5478fb5_2deb_4608_9181_4a9f831dd1c5.slice/crio-d341d620d4232c29a512a995cc4c26a1bca1bb5f490287bd4c7ea468046972fb WatchSource:0}: Error finding container d341d620d4232c29a512a995cc4c26a1bca1bb5f490287bd4c7ea468046972fb: Status 404 returned error can't find the container with id d341d620d4232c29a512a995cc4c26a1bca1bb5f490287bd4c7ea468046972fb Jul 02 15:00:48.418689 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.418669 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:00:48.430425 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:00:48.430404 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded0b6477_35e6_4e40_a294_0ef4a6c26e01.slice/crio-a870effa00cef5b3cf20bd4e9c83b379fabee1fd4e1e137ffdcb28491a818209 WatchSource:0}: Error finding container a870effa00cef5b3cf20bd4e9c83b379fabee1fd4e1e137ffdcb28491a818209: Status 404 returned error can't find the container with id a870effa00cef5b3cf20bd4e9c83b379fabee1fd4e1e137ffdcb28491a818209 Jul 02 15:00:48.996228 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.996205 2556 scope.go:117] "RemoveContainer" containerID="11b1de5396f2525981e74fdcc7a280a1b21065cd0ad2fa50a2891b0f335700e1" Jul 02 15:00:48.996701 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.996208 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:48.998010 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.997983 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" event={"ID":"b5478fb5-2deb-4608-9181-4a9f831dd1c5","Type":"ContainerStarted","Data":"d8adc8879406781cace0b3672633cfb667963ea518b01fb96f1a5b0532c9e6e7"} Jul 02 15:00:48.998153 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.998039 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:00:48.998153 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.998061 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" event={"ID":"b5478fb5-2deb-4608-9181-4a9f831dd1c5","Type":"ContainerStarted","Data":"d341d620d4232c29a512a995cc4c26a1bca1bb5f490287bd4c7ea468046972fb"} Jul 02 15:00:48.999489 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:48.999447 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xcp4x" Jul 02 15:00:49.001163 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.001142 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" event={"ID":"ed0b6477-35e6-4e40-a294-0ef4a6c26e01","Type":"ContainerStarted","Data":"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439"} Jul 02 15:00:49.001260 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.001185 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" event={"ID":"ed0b6477-35e6-4e40-a294-0ef4a6c26e01","Type":"ContainerStarted","Data":"a870effa00cef5b3cf20bd4e9c83b379fabee1fd4e1e137ffdcb28491a818209"} Jul 02 15:00:49.001333 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.001287 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:00:49.005842 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.005823 2556 scope.go:117] "RemoveContainer" containerID="795aaf49b6def1370b870e6e48306edb1172e97bd888e73e1cf3bad43514d22b" Jul 02 15:00:49.027008 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.026964 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" podStartSLOduration=2.026945253 podStartE2EDuration="2.026945253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:49.026756103 +0000 UTC m=+751.389573566" watchObservedRunningTime="2026-07-02 15:00:49.026945253 +0000 UTC m=+751.389762690" Jul 02 15:00:49.028944 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:00:49.028916 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bm9g2\" is forbidden: User \"system:node:ip-10-0-131-199.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-199.ec2.internal' and this object" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bm9g2" Jul 02 15:00:49.062506 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:49.062441 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" podStartSLOduration=2.062426045 podStartE2EDuration="2.062426045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:00:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:00:49.06076378 +0000 UTC m=+751.423581215" watchObservedRunningTime="2026-07-02 15:00:49.062426045 +0000 UTC m=+751.425243558" Jul 02 15:00:50.086443 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:50.086408 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73013ae6-9335-4656-8b7c-3e33387cc950" path="/var/lib/kubelet/pods/73013ae6-9335-4656-8b7c-3e33387cc950/volumes" Jul 02 15:00:50.086839 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:00:50.086812 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ba337fd-dc3d-4995-bb91-7666484ae8ec" path="/var/lib/kubelet/pods/8ba337fd-dc3d-4995-bb91-7666484ae8ec/volumes" Jul 02 15:01:00.010666 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:00.010633 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fqprf" Jul 02 15:01:00.011164 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:00.010944 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:01:05.665441 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:05.665408 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:01:05.665951 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:05.665642 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" podUID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" containerName="manager" containerID="cri-o://4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439" gracePeriod=10 Jul 02 15:01:06.411690 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.411663 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:01:06.436685 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.436660 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8cbq\" (UniqueName: \"kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq\") pod \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " Jul 02 15:01:06.436838 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.436694 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume\") pod \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\" (UID: \"ed0b6477-35e6-4e40-a294-0ef4a6c26e01\") " Jul 02 15:01:06.437077 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.437055 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ed0b6477-35e6-4e40-a294-0ef4a6c26e01" (UID: "ed0b6477-35e6-4e40-a294-0ef4a6c26e01"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 15:01:06.438701 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.438674 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq" (OuterVolumeSpecName: "kube-api-access-g8cbq") pod "ed0b6477-35e6-4e40-a294-0ef4a6c26e01" (UID: "ed0b6477-35e6-4e40-a294-0ef4a6c26e01"). InnerVolumeSpecName "kube-api-access-g8cbq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:01:06.538249 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.538169 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8cbq\" (UniqueName: \"kubernetes.io/projected/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-kube-api-access-g8cbq\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:01:06.538249 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:06.538197 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ed0b6477-35e6-4e40-a294-0ef4a6c26e01-extensions-socket-volume\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:01:07.104609 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.104574 2556 generic.go:356] "Generic (PLEG): container finished" podID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" containerID="4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439" exitCode=0 Jul 02 15:01:07.105015 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.104618 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" Jul 02 15:01:07.105015 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.104635 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" event={"ID":"ed0b6477-35e6-4e40-a294-0ef4a6c26e01","Type":"ContainerDied","Data":"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439"} Jul 02 15:01:07.105015 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.104683 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg" event={"ID":"ed0b6477-35e6-4e40-a294-0ef4a6c26e01","Type":"ContainerDied","Data":"a870effa00cef5b3cf20bd4e9c83b379fabee1fd4e1e137ffdcb28491a818209"} Jul 02 15:01:07.105015 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.104712 2556 scope.go:117] "RemoveContainer" containerID="4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439" Jul 02 15:01:07.114316 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.114297 2556 scope.go:117] "RemoveContainer" containerID="4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439" Jul 02 15:01:07.114571 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:01:07.114552 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439\": container with ID starting with 4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439 not found: ID does not exist" containerID="4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439" Jul 02 15:01:07.114642 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.114584 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439"} err="failed to get container status \"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439\": rpc error: code = NotFound desc = could not find container \"4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439\": container with ID starting with 4a04ffb6a926ba81749e18662b0024e9ff368f1f069351c8277f6afd70db7439 not found: ID does not exist" Jul 02 15:01:07.130144 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.130118 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:01:07.143265 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:07.143243 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-p7bkg"] Jul 02 15:01:08.086030 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:08.086000 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" path="/var/lib/kubelet/pods/ed0b6477-35e6-4e40-a294-0ef4a6c26e01/volumes" Jul 02 15:01:22.176764 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.176732 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6"] Jul 02 15:01:22.177260 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.177241 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" containerName="manager" Jul 02 15:01:22.177307 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.177263 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" containerName="manager" Jul 02 15:01:22.177392 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.177378 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed0b6477-35e6-4e40-a294-0ef4a6c26e01" containerName="manager" Jul 02 15:01:22.180313 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.180295 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.182619 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.182599 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 15:01:22.182717 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.182645 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xbt5c\"" Jul 02 15:01:22.182717 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.182682 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 15:01:22.182918 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.182906 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 15:01:22.193450 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.193409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6"] Jul 02 15:01:22.273054 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273054 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273060 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273269 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273083 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmx4l\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-kube-api-access-fmx4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273269 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273144 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273269 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273269 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273260 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273397 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273277 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273397 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273311 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.273397 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.273344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374099 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374061 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374099 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374119 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmx4l\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-kube-api-access-fmx4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374186 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374227 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374251 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374347 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374326 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374730 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374666 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374777 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374731 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374844 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374824 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.374955 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374935 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.375000 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.374957 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.376479 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.376447 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.376696 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.376676 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.382140 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.382114 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.382577 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.382561 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmx4l\" (UniqueName: \"kubernetes.io/projected/f4dd4420-f172-4b4f-aa38-0b52304bf9f5-kube-api-access-fmx4l\") pod \"maas-default-gateway-openshift-default-56654dcf7-pw5k6\" (UID: \"f4dd4420-f172-4b4f-aa38-0b52304bf9f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.493420 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.493337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:22.630204 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:22.630179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6"] Jul 02 15:01:22.632621 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:01:22.632599 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dd4420_f172_4b4f_aa38_0b52304bf9f5.slice/crio-2234fd488ce4f5a4b24cfa8e532db28140dc427d360166d41198eaef168891fd WatchSource:0}: Error finding container 2234fd488ce4f5a4b24cfa8e532db28140dc427d360166d41198eaef168891fd: Status 404 returned error can't find the container with id 2234fd488ce4f5a4b24cfa8e532db28140dc427d360166d41198eaef168891fd Jul 02 15:01:23.184215 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:23.184182 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" event={"ID":"f4dd4420-f172-4b4f-aa38-0b52304bf9f5","Type":"ContainerStarted","Data":"2234fd488ce4f5a4b24cfa8e532db28140dc427d360166d41198eaef168891fd"} Jul 02 15:01:26.400457 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:26.400418 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:01:26.400835 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:26.400520 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:01:26.400835 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:26.400577 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:01:27.207036 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:27.207000 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" event={"ID":"f4dd4420-f172-4b4f-aa38-0b52304bf9f5","Type":"ContainerStarted","Data":"67c2ce875d1d28b07b1c953c996efa710fcb54f5ed878fe3341f3f0fda1ee594"} Jul 02 15:01:27.226069 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:27.226015 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" podStartSLOduration=1.4609703170000001 podStartE2EDuration="5.225995626s" totalImagesPullingTime="3.765025309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:27.22463155 +0000 UTC m=+789.587448985" watchObservedRunningTime="2026-07-02 15:01:27.225995626 +0000 UTC m=+789.588813064" Jul 02 15:01:27.494376 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:27.494286 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:27.499139 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:27.499111 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:28.212035 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.212010 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:28.213062 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.213040 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:01:28.337551 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.337522 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:28.341109 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.341085 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.343038 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.343019 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 15:01:28.343163 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.343076 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zkdgw\"" Jul 02 15:01:28.349597 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.349578 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:28.429663 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.429635 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjsl\" (UniqueName: \"kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.429814 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.429674 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.440728 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.440700 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:28.530222 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.530138 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjsl\" (UniqueName: \"kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.530222 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.530184 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.530918 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.530900 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.537736 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.537705 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjsl\" (UniqueName: \"kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl\") pod \"limitador-limitador-64c94fd64f-r9768\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.651908 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.651867 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:28.787814 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:28.787789 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:28.789983 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:01:28.789959 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56322884_ca86_4165_8d20_82290ad5d9b4.slice/crio-3fb966eddb2498430150e436fbf720f2a3b2bd6112e41ddbf41bb44df8183034 WatchSource:0}: Error finding container 3fb966eddb2498430150e436fbf720f2a3b2bd6112e41ddbf41bb44df8183034: Status 404 returned error can't find the container with id 3fb966eddb2498430150e436fbf720f2a3b2bd6112e41ddbf41bb44df8183034 Jul 02 15:01:29.218390 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:29.218352 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" event={"ID":"56322884-ca86-4165-8d20-82290ad5d9b4","Type":"ContainerStarted","Data":"3fb966eddb2498430150e436fbf720f2a3b2bd6112e41ddbf41bb44df8183034"} Jul 02 15:01:32.238075 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:32.238040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" event={"ID":"56322884-ca86-4165-8d20-82290ad5d9b4","Type":"ContainerStarted","Data":"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df"} Jul 02 15:01:32.238440 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:32.238132 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:32.264619 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:32.264559 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" podStartSLOduration=1.330661299 podStartE2EDuration="4.264540813s" totalImagesPullingTime="2.933879514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:32.262736872 +0000 UTC m=+794.625554319" watchObservedRunningTime="2026-07-02 15:01:32.264540813 +0000 UTC m=+794.627358253" Jul 02 15:01:42.878596 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:42.878516 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:42.879060 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:42.878728 2556 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" podUID="56322884-ca86-4165-8d20-82290ad5d9b4" containerName="limitador" containerID="cri-o://99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df" gracePeriod=30 Jul 02 15:01:42.879419 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:42.879398 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:43.432554 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.432531 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:43.560780 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.560702 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file\") pod \"56322884-ca86-4165-8d20-82290ad5d9b4\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " Jul 02 15:01:43.560780 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.560771 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzjsl\" (UniqueName: \"kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl\") pod \"56322884-ca86-4165-8d20-82290ad5d9b4\" (UID: \"56322884-ca86-4165-8d20-82290ad5d9b4\") " Jul 02 15:01:43.561137 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.561110 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file" (OuterVolumeSpecName: "config-file") pod "56322884-ca86-4165-8d20-82290ad5d9b4" (UID: "56322884-ca86-4165-8d20-82290ad5d9b4"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 15:01:43.562790 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.562767 2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl" (OuterVolumeSpecName: "kube-api-access-tzjsl") pod "56322884-ca86-4165-8d20-82290ad5d9b4" (UID: "56322884-ca86-4165-8d20-82290ad5d9b4"). InnerVolumeSpecName "kube-api-access-tzjsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 15:01:43.662225 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.662190 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzjsl\" (UniqueName: \"kubernetes.io/projected/56322884-ca86-4165-8d20-82290ad5d9b4-kube-api-access-tzjsl\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:01:43.662225 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:43.662219 2556 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/56322884-ca86-4165-8d20-82290ad5d9b4-config-file\") on node \"ip-10-0-131-199.ec2.internal\" DevicePath \"\"" Jul 02 15:01:44.296301 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.296268 2556 generic.go:356] "Generic (PLEG): container finished" podID="56322884-ca86-4165-8d20-82290ad5d9b4" containerID="99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df" exitCode=0 Jul 02 15:01:44.296761 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.296318 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" Jul 02 15:01:44.296761 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.296353 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" event={"ID":"56322884-ca86-4165-8d20-82290ad5d9b4","Type":"ContainerDied","Data":"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df"} Jul 02 15:01:44.296761 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.296423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r9768" event={"ID":"56322884-ca86-4165-8d20-82290ad5d9b4","Type":"ContainerDied","Data":"3fb966eddb2498430150e436fbf720f2a3b2bd6112e41ddbf41bb44df8183034"} Jul 02 15:01:44.296761 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.296444 2556 scope.go:117] "RemoveContainer" containerID="99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df" Jul 02 15:01:44.305052 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.305033 2556 scope.go:117] "RemoveContainer" containerID="99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df" Jul 02 15:01:44.305296 ip-10-0-131-199 kubenswrapper[2556]: E0702 15:01:44.305277 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df\": container with ID starting with 99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df not found: ID does not exist" containerID="99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df" Jul 02 15:01:44.305344 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.305304 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df"} err="failed to get container status \"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df\": rpc error: code = NotFound desc = could not find container \"99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df\": container with ID starting with 99b46faa9d9599a2c0bc05c72ad3f0913a3d87442c1f1522103293aa8a0075df not found: ID does not exist" Jul 02 15:01:44.345268 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.345199 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:44.362208 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.362183 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r9768"] Jul 02 15:01:44.777002 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.776929 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-66mpx"] Jul 02 15:01:44.777351 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.777337 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56322884-ca86-4165-8d20-82290ad5d9b4" containerName="limitador" Jul 02 15:01:44.777398 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.777352 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="56322884-ca86-4165-8d20-82290ad5d9b4" containerName="limitador" Jul 02 15:01:44.777440 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.777431 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="56322884-ca86-4165-8d20-82290ad5d9b4" containerName="limitador" Jul 02 15:01:44.781612 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.781594 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.784186 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.784165 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 15:01:44.784303 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.784269 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-k8tb2\"" Jul 02 15:01:44.792101 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.792081 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-66mpx"] Jul 02 15:01:44.873269 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.873243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2531b923-7927-4a9d-95bb-b16d805a13df-data\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.873433 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.873292 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvwb\" (UniqueName: \"kubernetes.io/projected/2531b923-7927-4a9d-95bb-b16d805a13df-kube-api-access-zdvwb\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.974741 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.974702 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvwb\" (UniqueName: \"kubernetes.io/projected/2531b923-7927-4a9d-95bb-b16d805a13df-kube-api-access-zdvwb\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.974940 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.974786 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2531b923-7927-4a9d-95bb-b16d805a13df-data\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.975098 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.975083 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2531b923-7927-4a9d-95bb-b16d805a13df-data\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:44.984121 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:44.984096 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvwb\" (UniqueName: \"kubernetes.io/projected/2531b923-7927-4a9d-95bb-b16d805a13df-kube-api-access-zdvwb\") pod \"postgres-69fb4594cf-66mpx\" (UID: \"2531b923-7927-4a9d-95bb-b16d805a13df\") " pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:45.092185 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:45.092160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:45.223822 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:45.223798 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-66mpx"] Jul 02 15:01:45.226400 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:01:45.226366 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2531b923_7927_4a9d_95bb_b16d805a13df.slice/crio-b0e11287af0abcc815138abf6dfd3b0dcbd3d5eb0444029962d9c239777457be WatchSource:0}: Error finding container b0e11287af0abcc815138abf6dfd3b0dcbd3d5eb0444029962d9c239777457be: Status 404 returned error can't find the container with id b0e11287af0abcc815138abf6dfd3b0dcbd3d5eb0444029962d9c239777457be Jul 02 15:01:45.304277 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:45.304240 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-66mpx" event={"ID":"2531b923-7927-4a9d-95bb-b16d805a13df","Type":"ContainerStarted","Data":"b0e11287af0abcc815138abf6dfd3b0dcbd3d5eb0444029962d9c239777457be"} Jul 02 15:01:46.086608 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:46.086575 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56322884-ca86-4165-8d20-82290ad5d9b4" path="/var/lib/kubelet/pods/56322884-ca86-4165-8d20-82290ad5d9b4/volumes" Jul 02 15:01:51.339573 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:51.339540 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-66mpx" event={"ID":"2531b923-7927-4a9d-95bb-b16d805a13df","Type":"ContainerStarted","Data":"cc25fdcca411e77445a313d782c5a5f1a70174329d822b0b567ab9a132bafdf6"} Jul 02 15:01:51.340093 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:51.339665 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:01:51.356320 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:51.356278 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-66mpx" podStartSLOduration=1.711841087 podStartE2EDuration="7.356263084s" totalImagesPullingTime="5.644421997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:01:51.353958928 +0000 UTC m=+813.716776365" watchObservedRunningTime="2026-07-02 15:01:51.356263084 +0000 UTC m=+813.719080520" Jul 02 15:01:57.374816 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:01:57.374788 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-66mpx" Jul 02 15:02:06.627758 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.627710 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc"] Jul 02 15:02:06.636429 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.636402 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" Jul 02 15:02:06.638828 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.638801 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-7vpfj\"" Jul 02 15:02:06.638976 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.638846 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 02 15:02:06.639633 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.639614 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 02 15:02:06.646326 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.646302 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc"] Jul 02 15:02:06.689698 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.689667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thf8j\" (UniqueName: \"kubernetes.io/projected/b0a04c15-51a3-474a-9bca-b9f9526f4435-kube-api-access-thf8j\") pod \"keycloak-operator-d8b9d7b4d-zjvfc\" (UID: \"b0a04c15-51a3-474a-9bca-b9f9526f4435\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" Jul 02 15:02:06.790735 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.790695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thf8j\" (UniqueName: \"kubernetes.io/projected/b0a04c15-51a3-474a-9bca-b9f9526f4435-kube-api-access-thf8j\") pod \"keycloak-operator-d8b9d7b4d-zjvfc\" (UID: \"b0a04c15-51a3-474a-9bca-b9f9526f4435\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" Jul 02 15:02:06.802398 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.802366 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thf8j\" (UniqueName: \"kubernetes.io/projected/b0a04c15-51a3-474a-9bca-b9f9526f4435-kube-api-access-thf8j\") pod \"keycloak-operator-d8b9d7b4d-zjvfc\" (UID: \"b0a04c15-51a3-474a-9bca-b9f9526f4435\") " pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" Jul 02 15:02:06.946756 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:06.946649 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" Jul 02 15:02:07.074568 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:07.074544 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc"] Jul 02 15:02:07.076728 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:02:07.076701 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a04c15_51a3_474a_9bca_b9f9526f4435.slice/crio-b08a204b92adba7afad187341df8e64657b3b67baa3b8cf57e6508d50778d1bf WatchSource:0}: Error finding container b08a204b92adba7afad187341df8e64657b3b67baa3b8cf57e6508d50778d1bf: Status 404 returned error can't find the container with id b08a204b92adba7afad187341df8e64657b3b67baa3b8cf57e6508d50778d1bf Jul 02 15:02:07.417023 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:07.416990 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" event={"ID":"b0a04c15-51a3-474a-9bca-b9f9526f4435","Type":"ContainerStarted","Data":"b08a204b92adba7afad187341df8e64657b3b67baa3b8cf57e6508d50778d1bf"} Jul 02 15:02:15.460090 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:15.460049 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" event={"ID":"b0a04c15-51a3-474a-9bca-b9f9526f4435","Type":"ContainerStarted","Data":"97a5654592a0f2d4f4db6a545aa7f24d5aadf316def6784fbf64885eec7408d8"} Jul 02 15:02:15.478388 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:02:15.478341 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d8b9d7b4d-zjvfc" podStartSLOduration=2.01860712 podStartE2EDuration="9.478326695s" totalImagesPullingTime="7.459719575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:02:15.475779293 +0000 UTC m=+837.838596731" watchObservedRunningTime="2026-07-02 15:02:15.478326695 +0000 UTC m=+837.841144130" Jul 02 15:03:18.082145 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:18.082113 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 15:03:18.083374 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:18.083350 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-smsbw_4eb3595c-f569-4edd-98a3-1fa60e64dd50/ovn-acl-logging/0.log" Jul 02 15:03:48.922754 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.922715 2556 generic.go:356] "Generic (PLEG): container finished" podID="f4dd4420-f172-4b4f-aa38-0b52304bf9f5" containerID="67c2ce875d1d28b07b1c953c996efa710fcb54f5ed878fe3341f3f0fda1ee594" exitCode=0 Jul 02 15:03:48.923285 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.922770 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" event={"ID":"f4dd4420-f172-4b4f-aa38-0b52304bf9f5","Type":"ContainerDied","Data":"67c2ce875d1d28b07b1c953c996efa710fcb54f5ed878fe3341f3f0fda1ee594"} Jul 02 15:03:48.923379 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.923288 2556 scope.go:117] "RemoveContainer" containerID="67c2ce875d1d28b07b1c953c996efa710fcb54f5ed878fe3341f3f0fda1ee594" Jul 02 15:03:48.924332 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.924300 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:03:48.924439 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.924372 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:03:48.924439 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:48.924401 2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 02 15:03:49.931401 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:49.931366 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" event={"ID":"f4dd4420-f172-4b4f-aa38-0b52304bf9f5","Type":"ContainerStarted","Data":"e5edbd1e04ce7adc3ac9ea1004055f8bad7c6c361c00e0a7bd7fb4a30c6a1dfd"} Jul 02 15:03:50.493554 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:50.493525 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:03:50.493731 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:50.493702 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pw5k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 02 15:03:50.493775 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:50.493745 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" podUID="f4dd4420-f172-4b4f-aa38-0b52304bf9f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 02 15:03:51.494281 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:51.494244 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pw5k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 02 15:03:51.494702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:51.494300 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" podUID="f4dd4420-f172-4b4f-aa38-0b52304bf9f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 02 15:03:52.494076 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:52.494044 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pw5k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 02 15:03:52.494257 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:52.494097 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" podUID="f4dd4420-f172-4b4f-aa38-0b52304bf9f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 02 15:03:53.494664 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:53.494627 2556 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-pw5k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jul 02 15:03:53.495045 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:53.494688 2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" podUID="f4dd4420-f172-4b4f-aa38-0b52304bf9f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jul 02 15:03:54.497652 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:54.497571 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:03:54.498024 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:54.497983 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:03:54.498546 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:03:54.498531 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-pw5k6" Jul 02 15:04:58.391932 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.391896 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv"] Jul 02 15:04:58.394849 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.394828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.397168 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.397146 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 15:04:58.397301 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.397179 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 02 15:04:58.397861 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.397847 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 15:04:58.397978 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.397883 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xv29t\"" Jul 02 15:04:58.406097 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.406076 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv"] Jul 02 15:04:58.424601 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424563 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.424601 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8b4p\" (UniqueName: \"kubernetes.io/projected/81fce1ec-0b07-4a57-84a0-0131a1873a7b-kube-api-access-f8b4p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.424844 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424626 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.424844 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424743 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.424844 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424785 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.424844 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.424811 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525679 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525679 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8b4p\" (UniqueName: \"kubernetes.io/projected/81fce1ec-0b07-4a57-84a0-0131a1873a7b-kube-api-access-f8b4p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525902 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525902 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525902 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.525902 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.525849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.526157 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.526136 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.526224 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.526188 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.526279 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.526245 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.527962 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.527940 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81fce1ec-0b07-4a57-84a0-0131a1873a7b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.528206 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.528188 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81fce1ec-0b07-4a57-84a0-0131a1873a7b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.534692 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.534669 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8b4p\" (UniqueName: \"kubernetes.io/projected/81fce1ec-0b07-4a57-84a0-0131a1873a7b-kube-api-access-f8b4p\") pod \"e2e-trlp-test-simulated-kserve-598466548d-dpxfv\" (UID: \"81fce1ec-0b07-4a57-84a0-0131a1873a7b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.706329 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.706237 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:04:58.844103 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.844065 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv"] Jul 02 15:04:58.848154 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:04:58.848130 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fce1ec_0b07_4a57_84a0_0131a1873a7b.slice/crio-3d41723c41dd7e3a63bd5fd0e655c48b6b12b9999b44776cbd6a8a5524c57da2 WatchSource:0}: Error finding container 3d41723c41dd7e3a63bd5fd0e655c48b6b12b9999b44776cbd6a8a5524c57da2: Status 404 returned error can't find the container with id 3d41723c41dd7e3a63bd5fd0e655c48b6b12b9999b44776cbd6a8a5524c57da2 Jul 02 15:04:58.849850 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:58.849836 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 15:04:59.285984 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:04:59.285936 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" event={"ID":"81fce1ec-0b07-4a57-84a0-0131a1873a7b","Type":"ContainerStarted","Data":"3d41723c41dd7e3a63bd5fd0e655c48b6b12b9999b44776cbd6a8a5524c57da2"} Jul 02 15:05:00.292828 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:00.292731 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" event={"ID":"81fce1ec-0b07-4a57-84a0-0131a1873a7b","Type":"ContainerStarted","Data":"1f9e1af453b58e046bb8e85c32e50b07d9cf9eaabf4e01905e4fa9a056c47a55"} Jul 02 15:05:00.309128 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:00.309070 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" podStartSLOduration=1.254258979 podStartE2EDuration="2.309051911s" totalImagesPullingTime="1.054792932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:04:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:05:00.308708361 +0000 UTC m=+1002.671525798" watchObservedRunningTime="2026-07-02 15:05:00.309051911 +0000 UTC m=+1002.671869350" Jul 02 15:05:04.280824 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.280795 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg"] Jul 02 15:05:04.283685 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.283669 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.285646 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.285622 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 02 15:05:04.295505 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.295456 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg"] Jul 02 15:05:04.378017 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.377986 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.378176 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.378038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.378176 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.378065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d2218a9-dab5-4712-915d-2a881de77778-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.378176 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.378095 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgx5x\" (UniqueName: \"kubernetes.io/projected/6d2218a9-dab5-4712-915d-2a881de77778-kube-api-access-lgx5x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.378332 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.378191 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.378332 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.378224 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479503 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479443 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479513 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d2218a9-dab5-4712-915d-2a881de77778-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgx5x\" (UniqueName: \"kubernetes.io/projected/6d2218a9-dab5-4712-915d-2a881de77778-kube-api-access-lgx5x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479702 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479628 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.479965 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479931 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.480016 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.479935 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.480084 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.480039 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.481848 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.481828 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d2218a9-dab5-4712-915d-2a881de77778-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.481987 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.481972 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d2218a9-dab5-4712-915d-2a881de77778-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.492061 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.492037 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgx5x\" (UniqueName: \"kubernetes.io/projected/6d2218a9-dab5-4712-915d-2a881de77778-kube-api-access-lgx5x\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg\" (UID: \"6d2218a9-dab5-4712-915d-2a881de77778\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.594663 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.594627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:04.727531 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:04.727505 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg"] Jul 02 15:05:04.730068 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:05:04.730039 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2218a9_dab5_4712_915d_2a881de77778.slice/crio-4927477b3da11984f3b5279d508b85f4a8238dc8b9c2c326c76c332ebe7d4cb5 WatchSource:0}: Error finding container 4927477b3da11984f3b5279d508b85f4a8238dc8b9c2c326c76c332ebe7d4cb5: Status 404 returned error can't find the container with id 4927477b3da11984f3b5279d508b85f4a8238dc8b9c2c326c76c332ebe7d4cb5 Jul 02 15:05:05.328407 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:05.328365 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" event={"ID":"6d2218a9-dab5-4712-915d-2a881de77778","Type":"ContainerStarted","Data":"6b128378701b8f636dcb7ba1a68175b762539ff51c0528fa6196dda41af6016e"} Jul 02 15:05:05.328852 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:05.328499 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" event={"ID":"6d2218a9-dab5-4712-915d-2a881de77778","Type":"ContainerStarted","Data":"4927477b3da11984f3b5279d508b85f4a8238dc8b9c2c326c76c332ebe7d4cb5"} Jul 02 15:05:08.706631 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:08.706588 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:05:08.707101 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:08.706659 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:05:08.719245 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:08.719212 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:05:08.741746 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:08.741695 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" podStartSLOduration=4.212931869 podStartE2EDuration="4.741676841s" totalImagesPullingTime="528.744972ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 15:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:05:05.358647416 +0000 UTC m=+1007.721464852" watchObservedRunningTime="2026-07-02 15:05:08.741676841 +0000 UTC m=+1011.104494289" Jul 02 15:05:09.358075 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:09.358045 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-dpxfv" Jul 02 15:05:14.595562 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:14.595523 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:14.595933 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:14.595596 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:14.607898 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:14.607876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:05:15.386585 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:05:15.386559 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg" Jul 02 15:07:12.437073 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:12.437042 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dvql6_cfb3e16d-09de-4c87-83d1-44971674a5e8/manager/0.log" Jul 02 15:07:12.552927 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:12.552896 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2rhfw_c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db/manager/0.log" Jul 02 15:07:13.149559 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:13.149531 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-4rlxc_ecbee67f-2c17-4a8c-bb66-19faf75018d0/copy-manifests/0.log" Jul 02 15:07:13.156856 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:13.156833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-4rlxc_ecbee67f-2c17-4a8c-bb66-19faf75018d0/manager/0.log" Jul 02 15:07:13.516908 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:13.516824 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-66mpx_2531b923-7927-4a9d-95bb-b16d805a13df/postgres/0.log" Jul 02 15:07:15.002256 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:15.002225 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8vt9k_dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc/manager/0.log" Jul 02 15:07:15.245102 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:15.245077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pq669_3473bf4c-6d29-42dc-b6c8-488034c56a66/registry-server/0.log" Jul 02 15:07:15.625565 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:15.625536 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fqprf_b5478fb5-2deb-4608-9181-4a9f831dd1c5/manager/0.log" Jul 02 15:07:16.416927 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:16.416898 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/1.log" Jul 02 15:07:17.327590 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:17.327558 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-dpxfv_81fce1ec-0b07-4a57-84a0-0131a1873a7b/main/0.log" Jul 02 15:07:17.443452 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:17.443426 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv2bhg_6d2218a9-dab5-4712-915d-2a881de77778/main/0.log" Jul 02 15:07:24.491924 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:24.491896 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9mrw9_cd1bac5c-4bd8-4cf7-8636-16934550df45/global-pull-secret-syncer/0.log" Jul 02 15:07:24.611169 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:24.611137 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h82zf_5812f804-ea2f-4103-bc95-4841140f4fbe/konnectivity-agent/0.log" Jul 02 15:07:24.683437 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:24.683407 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-199.ec2.internal_ebed2cfefda3d3501e2c36adef46adbf/haproxy/0.log" Jul 02 15:07:30.063257 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:30.063224 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-8vt9k_dcab8de0-57d6-42f4-a4aa-2419dbc7d6fc/manager/0.log" Jul 02 15:07:30.120842 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:30.120808 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pq669_3473bf4c-6d29-42dc-b6c8-488034c56a66/registry-server/0.log" Jul 02 15:07:30.230567 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:30.230535 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fqprf_b5478fb5-2deb-4608-9181-4a9f831dd1c5/manager/0.log" Jul 02 15:07:32.215550 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.215520 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-dcnqw_5d4a50e8-e90a-445f-8799-8efd8c4c02b0/kube-state-metrics/0.log" Jul 02 15:07:32.237297 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.237275 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-dcnqw_5d4a50e8-e90a-445f-8799-8efd8c4c02b0/kube-rbac-proxy-main/0.log" Jul 02 15:07:32.260453 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.260387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-dcnqw_5d4a50e8-e90a-445f-8799-8efd8c4c02b0/kube-rbac-proxy-self/0.log" Jul 02 15:07:32.290072 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.290046 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54cd549444-825pr_23c749b8-3f7d-442e-a7c8-f0b1f0820167/metrics-server/0.log" Jul 02 15:07:32.324491 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.324439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-v5vlt_7e5e49f3-c182-44ab-a1f8-9f1f18d57f10/monitoring-plugin/0.log" Jul 02 15:07:32.358230 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.358205 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9ff5k_162b249b-69f7-405e-85c5-cf34def33a3d/node-exporter/0.log" Jul 02 15:07:32.380203 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.380176 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9ff5k_162b249b-69f7-405e-85c5-cf34def33a3d/kube-rbac-proxy/0.log" Jul 02 15:07:32.405415 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.405394 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9ff5k_162b249b-69f7-405e-85c5-cf34def33a3d/init-textfile/0.log" Jul 02 15:07:32.618650 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.618616 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-nsr9k_df1288c8-cddd-4dd8-96d4-1d12bb9f632f/kube-rbac-proxy-main/0.log" Jul 02 15:07:32.652714 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.652689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-nsr9k_df1288c8-cddd-4dd8-96d4-1d12bb9f632f/kube-rbac-proxy-self/0.log" Jul 02 15:07:32.677073 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.677051 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-nsr9k_df1288c8-cddd-4dd8-96d4-1d12bb9f632f/openshift-state-metrics/0.log" Jul 02 15:07:32.714891 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.714858 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/prometheus/0.log" Jul 02 15:07:32.738103 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.738077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/config-reloader/0.log" Jul 02 15:07:32.762340 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.762318 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/thanos-sidecar/0.log" Jul 02 15:07:32.787574 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.787555 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/kube-rbac-proxy-web/0.log" Jul 02 15:07:32.816720 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.816704 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/kube-rbac-proxy/0.log" Jul 02 15:07:32.840414 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.840396 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/kube-rbac-proxy-thanos/0.log" Jul 02 15:07:32.864670 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.864651 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4184ad63-54d1-4217-8a8a-100ccf5f82ca/init-config-reloader/0.log" Jul 02 15:07:32.895753 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.895689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-vlp75_6b1404da-532d-426d-9b75-55982d74088b/prometheus-operator/0.log" Jul 02 15:07:32.917031 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.917011 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7b7d896497-vlp75_6b1404da-532d-426d-9b75-55982d74088b/kube-rbac-proxy/0.log" Jul 02 15:07:32.959156 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:32.959135 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7ddc8784d4-5978d_edf34bb0-7228-438e-b262-e86bb4528a88/prometheus-operator-admission-webhook/0.log" Jul 02 15:07:34.381575 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.381538 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6"] Jul 02 15:07:34.385393 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.385369 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.387733 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.387708 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"openshift-service-ca.crt\"" Jul 02 15:07:34.387733 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.387723 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t4j7n\"/\"kube-root-ca.crt\"" Jul 02 15:07:34.388335 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.388315 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t4j7n\"/\"default-dockercfg-fj28k\"" Jul 02 15:07:34.392265 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.392241 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6"] Jul 02 15:07:34.539755 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.539711 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-sys\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.539755 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.539761 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-proc\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.540013 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.539781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-lib-modules\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.540013 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.539798 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nqvq\" (UniqueName: \"kubernetes.io/projected/2876910f-cbe6-4754-a928-7ffe27a516f8-kube-api-access-7nqvq\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.540013 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.539875 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-podres\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640565 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-sys\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640565 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-proc\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-lib-modules\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640595 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-sys\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nqvq\" (UniqueName: \"kubernetes.io/projected/2876910f-cbe6-4754-a928-7ffe27a516f8-kube-api-access-7nqvq\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640659 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-proc\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640666 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-podres\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640749 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640727 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-lib-modules\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.640938 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.640756 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2876910f-cbe6-4754-a928-7ffe27a516f8-podres\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.648106 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.648074 2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nqvq\" (UniqueName: \"kubernetes.io/projected/2876910f-cbe6-4754-a928-7ffe27a516f8-kube-api-access-7nqvq\") pod \"perf-node-gather-daemonset-zc9v6\" (UID: \"2876910f-cbe6-4754-a928-7ffe27a516f8\") " pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.696112 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.696076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:34.831687 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:34.831663 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6"] Jul 02 15:07:34.833981 ip-10-0-131-199 kubenswrapper[2556]: W0702 15:07:34.833959 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2876910f_cbe6_4754_a928_7ffe27a516f8.slice/crio-a3c8b804e3ddbf2fe18135433b786cd84f2c7c4ae8c804f13b5532d184b30498 WatchSource:0}: Error finding container a3c8b804e3ddbf2fe18135433b786cd84f2c7c4ae8c804f13b5532d184b30498: Status 404 returned error can't find the container with id a3c8b804e3ddbf2fe18135433b786cd84f2c7c4ae8c804f13b5532d184b30498 Jul 02 15:07:35.071954 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:35.071921 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" event={"ID":"2876910f-cbe6-4754-a928-7ffe27a516f8","Type":"ContainerStarted","Data":"fc7272aeacf9763f0407a3d35b3b922e6c33e2f2ec5c9c5bf90c1c1a5fb9f562"} Jul 02 15:07:35.072124 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:35.071976 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" event={"ID":"2876910f-cbe6-4754-a928-7ffe27a516f8","Type":"ContainerStarted","Data":"a3c8b804e3ddbf2fe18135433b786cd84f2c7c4ae8c804f13b5532d184b30498"} Jul 02 15:07:35.072124 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:35.072045 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:35.088339 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:35.088279 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" podStartSLOduration=1.088259739 podStartE2EDuration="1.088259739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 15:07:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 15:07:35.087795647 +0000 UTC m=+1157.450613085" watchObservedRunningTime="2026-07-02 15:07:35.088259739 +0000 UTC m=+1157.451077176" Jul 02 15:07:36.218261 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:36.218222 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-7r5g8_87f2b6d6-b7d9-47fb-af67-c6b3f376adcf/volume-data-source-validator/0.log" Jul 02 15:07:37.350030 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:37.350002 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf4zq_5a99a7d6-9f0e-42f2-80fe-b63255a41f78/dns/0.log" Jul 02 15:07:37.371193 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:37.371164 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zf4zq_5a99a7d6-9f0e-42f2-80fe-b63255a41f78/kube-rbac-proxy/0.log" Jul 02 15:07:37.442236 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:37.442204 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pgr9x_31468509-9602-47e0-a0b6-c441b943d622/dns-node-resolver/0.log" Jul 02 15:07:38.070902 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:38.070877 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh76s_83aacf8c-2ff4-414f-9877-418f528d0e7c/node-ca/0.log" Jul 02 15:07:39.126985 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:39.126911 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/1.log" Jul 02 15:07:39.127514 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:39.127129 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/0.log" Jul 02 15:07:39.840284 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:39.840256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mb7rb_46c466dd-a352-40cd-8551-15281b2cf831/serve-healthcheck-canary/0.log" Jul 02 15:07:40.403553 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:40.403521 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-lf59p_718fb371-8599-401e-abe1-54124f3244fa/insights-operator/1.log" Jul 02 15:07:40.403954 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:40.403770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-lf59p_718fb371-8599-401e-abe1-54124f3244fa/insights-operator/0.log" Jul 02 15:07:40.620714 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:40.620686 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfj6f_79dd1e91-02b6-437a-8402-34458a1095bf/kube-rbac-proxy/0.log" Jul 02 15:07:40.645593 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:40.645570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfj6f_79dd1e91-02b6-437a-8402-34458a1095bf/exporter/0.log" Jul 02 15:07:40.668049 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:40.667965 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wfj6f_79dd1e91-02b6-437a-8402-34458a1095bf/extractor/0.log" Jul 02 15:07:41.087452 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:41.087427 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t4j7n/perf-node-gather-daemonset-zc9v6" Jul 02 15:07:42.808824 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:42.808798 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dvql6_cfb3e16d-09de-4c87-83d1-44971674a5e8/manager/0.log" Jul 02 15:07:42.844276 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:42.844241 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-2rhfw_c34f3ecc-eec1-4e3e-a266-7ccb4fffe9db/manager/0.log" Jul 02 15:07:43.030912 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:43.030878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-4rlxc_ecbee67f-2c17-4a8c-bb66-19faf75018d0/manager/0.log" Jul 02 15:07:43.057604 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:43.057572 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-758bbf8cc7-4rlxc_ecbee67f-2c17-4a8c-bb66-19faf75018d0/copy-manifests/0.log" Jul 02 15:07:43.219568 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:43.219537 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-66mpx_2531b923-7927-4a9d-95bb-b16d805a13df/postgres/0.log" Jul 02 15:07:44.813624 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:44.813600 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5bdfcfdbc4-f5kss_4aadd15a-45f4-4618-b53e-913a18e6a18e/manager/0.log" Jul 02 15:07:44.839378 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:44.839333 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-t5pd6_840d85e6-9464-4ae3-b341-3dc9478b3586/openshift-lws-operator/0.log" Jul 02 15:07:45.533946 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:45.533913 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/1.log" Jul 02 15:07:45.534196 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:45.534182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/0.log" Jul 02 15:07:46.767105 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:46.767077 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/1.log" Jul 02 15:07:46.767499 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:46.767323 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-pw5k6_f4dd4420-f172-4b4f-aa38-0b52304bf9f5/istio-proxy/0.log" Jul 02 15:07:49.825190 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:49.825158 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-gmf6n_cc24d55f-b48c-4e22-a7f1-e804eab7da1a/migrator/0.log" Jul 02 15:07:49.846373 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:49.846336 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-gmf6n_cc24d55f-b48c-4e22-a7f1-e804eab7da1a/graceful-termination/0.log" Jul 02 15:07:51.220705 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.220673 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9vl9j_62236a31-896b-491c-b2af-e4f2e0b25061/kube-multus/0.log" Jul 02 15:07:51.563727 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.563655 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/kube-multus-additional-cni-plugins/0.log" Jul 02 15:07:51.586097 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.586069 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/egress-router-binary-copy/0.log" Jul 02 15:07:51.607099 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.607074 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/cni-plugins/0.log" Jul 02 15:07:51.627816 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.627792 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/bond-cni-plugin/0.log" Jul 02 15:07:51.648329 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.648301 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/routeoverride-cni/0.log" Jul 02 15:07:51.669858 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.669835 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/whereabouts-cni-bincopy/0.log" Jul 02 15:07:51.690649 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.690625 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7knw_dd9c66a5-dc2d-4e26-a947-cdf802303f3d/whereabouts-cni/0.log" Jul 02 15:07:51.878870 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.878844 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pls7k_2ca7704b-8f91-4c64-8f35-0f295d28debd/network-metrics-daemon/0.log" Jul 02 15:07:51.902854 ip-10-0-131-199 kubenswrapper[2556]: I0702 15:07:51.902827 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pls7k_2ca7704b-8f91-4c64-8f35-0f295d28debd/kube-rbac-proxy/0.log"